Video: Dreams from feedback in predictive model

Posted: October 11, 2017 at 9:04 am

Video of a dream (imaginary sequence generated from feedback in predictive model):


Dreams from feedback in predictive model

Posted: October 3, 2017 at 10:25 am

After some experimentation with LSTM topologies, I ended up with a 8 layer network with 32 LSTM units per hidden layer. These networks take a lot longer to train and the MSE for my 10,000 iteration test was 0.0201 (worse than other topologies). The amazing part is that using the feedback mechanism to reconstruct the sequence, scene transitions are preserved! In my previous single and 4 layer LSTM tests, the scene changes were not reconstructed using feedback in the model. The image below shows the results.

predictions_batch1_i10000_feedback_8Layer (more…)