RPG Learning!

For fun, I built a continuous, curriculum-based learning setup for small LLMs and wrapped it in an RPG theme.

Repo: https://github.com/definitelynotrussellkirk-bit/TRAINING

In this setup:

- Your hero DIO (a Qwen3 model) runs quests (training data files), fights battles (training runs), and levels up over time.

- Damage dealt is defined as 1 / loss, so lower loss means bigger hits.

- The Tavern (web UI) is where you watch training, see hero stats, check the queue, browse the Vault (checkpoints), and talk to the model via the Oracle.

- The Temple / Cleric handle validations and rituals (health checks, sanity checks on data and training).

- Training Schools like Scribe, Mirror, Judge, Champion, Whisper, and Oracle map to different learning methods (SFT, sparring, DPO, RLHF, distillation, etc.).

Under the hood it’s a continuous fine-tuning system:

- Queue-based data flow: drop .jsonl files into inbox/, they become quests and get processed.

- Continuous hero loop: if there’s data, it trains; if not, it can generate more data according to a curriculum (skill priorities, idle generation).

- Checkpoint management and cleanup via the Vault.

- A VRAM-aware settings page aimed at single-GPU setups (e.g., 16–24GB VRAM).

It’s a work in progress and still evolving, but it mostly works end to end on my machines.

Open to any feedback, ideas, or critiques from anyone who’s curious.