I trained a tiny (6M-param) attention-free model you can chat with, generates a sentence in ~5 ms on CPU, no GPU, no pretrained embeddings. Honest writeup. [P]