Topic analysis

Soul Player C64 – A real transformer running on a 1 MHz Commodore 64

Soul Player C64 implements a 2-layer transformer model in 6502 assembly, enabling LLM inference on a 1 MHz Commodore 64. The project uses quantization-aware training to fit a 25,000 parameter model on a floppy disk, featuring real multi-head self-attention and RMSNorm.