Skip to content

Tiny world model generates games and stream ac plays them all on Pico 2W

Gifs

Sebastian Nae93474fb7fb85
diff --git a/README.md b/README.md
index 466af0a..2af4951 100644
--- a/README.md
+++ b/README.md
@@ -12,11 +12,11 @@ Every frame above was sampled by the world model network, and the actions were t
I got interested in looped transformers, where one transformer block is applied several times with the same weights instead of stacking different layers. Reusing weights is cheap on memory, so I wanted to see if a looped world model could be small enough to run on a microcontroller. I picked the Pico 2 W because it is cheap and has an FPU, and small games because I could write the real versions directly into numpy and check every generated frame against them. Later I added a streaming RL agent so the board could also learn to play inside its own dream.
-Contents: [the two networks](#the-dream-and-the-actor) · [the games](#the-games) · [the world model](#how-the-world-model-works) · [the agents](#the-agents-stream-x) · [quantization](#quantization-and-the-pico) · [on the chip](#on-the-chip) · [flashing](#flashing-a-game-and-an-agent) · [browser](#in-the-browser) · [reproduce](#reproduce) · [code layout](#code-layout)
+Contents: [the two networks](#the-world-model-and-the-actor) · [the games](#the-games) · [the world model](#how-the-world-model-works) · [the agents](#the-agents-stream-x) · [quantization](#quantization-and-the-pico) · [on the chip](#on-the-chip) · [flashing](#flashing-a-game-and-an-agent) · [browser](#in-the-browser) · [reproduce](#reproduce) · [code layout](#code-layout)
-## The dream and the actor
+## The world model and the actor
-![the dream and the actor](docs/media/explain_twonetworks.gif)
+![the world model and the actor](docs/media/explain_twonetworks.gif)
| | network 1: the world model | network 2: the actor |
|---|---|---|
diff --git a/docs/media/explain_twonetworks.gif b/docs/media/explain_twonetworks.gif
index 7424b84..d6c54cf 100644
Binary files a/docs/media/explain_twonetworks.gif and b/docs/media/explain_twonetworks.gif differ