Dreams from feedback in predictive model

After some experimentation with LSTM topologies, I ended up with a 8 layer network with 32 LSTM units per hidden layer. These networks take a lot longer to train and the MSE for my 10,000 iteration test was 0.0201 (worse than other topologies). The amazing part is that using the feedback mechanism to reconstruct the sequence, scene transitions are preserved! In my previous single and 4 layer LSTM tests, the scene changes were not reconstructed using feedback in the model. The image below shows the results.

predictions_batch1_i10000_feedback_8Layer

Read more