๐Ÿ’ค Pong Dreams

A neural net watches Pong until it learns how the world works โ€” then the game switches off and you play inside the network's dream, where every frame is hallucinated and physics is whatever it believes physics to be.

reality

what the net expects next

press start โ€” the net begins by watching

Train until the loss flattens and the prediction panel looks like the game (~a minute). Then enter the dream: the simulator stops feeding the screen โ€” the net predicts frame t+1 from its own frames t and tโˆ’1, plus your paddle input. The opponent you play against in there isn't programmed anymore; it's the net's memory of the opponent. Dreams decay โ€” when the ball dissolves, re-seed.