Qwen3-30B-A3B running at 5.5-7.2 tok/s on a 4GB GTX 1050 Ti

been messing around with an old GTX 1050 Ti

Thing is, Qwen3-30B-A3B only activates 8 of its 128 experts per layer per token ("A3B" = active 3B). So most of the 30B just sits there unused for any given token. But which 8 experts get picked isn't random, some layers reuse basically the same handful of experts constantly, other layers pick almost uniformly at random across the whole pool.

So I traced and ranked layers by how much their expert-set overlaps step to step, and pinned the high-overlap layers to GPU

Numbers on the same box the whole way through:

• CPU only: 1.4 tok/s
• Hot-layer placement: 5.5 tok/s benchmarked, 7.2 tok/s once warm in real serving

Repo: https://github.com/ZneidiMohamedAmine/moe-hot-layers

Also found two other projects doing adjacent things (linked in the README) if you want to go further than the static placement this does.