Stuff Generative AI into a 4 MB Microcontroller and Wait 20 Seconds for a Face
Running Generative AI On An RP2350
Generative image models usually suggest large GPUs, but this project asks whether one can be squeezed into an RP2350 microcontroller with just 4 MB of flash. It produces 128×128-pixel faces at roughly one image every 20 seconds.
The model and inference code fit into the tiny memory budget, and output can even be displayed directly through a VGA adapter. Instead of scaling AI upward, the project explores how far it can be compressed downward.
While everyone else adds GPUs, someone is removing things until the model fits in 4 MB. It's satisfying to see the race run backward.