Controller Input

[zhefan]

Hi, I wonder if the input to the controller should be the latent vector (z) from VAE and hidden vector from RNN?

world-models/utils/misc.py

Line 161 in d6abd9c

_, _, _, _, _, next_hidden = self.mdrnn(action, latent_mu, hidden)

But the code here shows that one of the inputs is the gaussian mean instead.

[pdeubel]

Yes I though the same, as it turns out there was already a discussion about this in #28. Seems like it does not affect the performance of that particular environment, nevertheless I think the correct latent vector z should be used