MoE offloaded - advice on difference between Intel vs AMD CPU instruction sets

Hi,

I'm in the process of upgrading my Framework 13 7840u to the new Framework 13 Pro. My LLM setup is admittedly a bit suboptimal. I have an RTX 5080 connected via TB4 eGPU (Razor Core X V2). This setup works fine for gaming but for LLMs, if any offloading happens it can be slowish. I get approx 1000 PP/s prefill and 50-70 t/s decode with Qwen 3.6 35B-A3B.

My understanding is Intel's processors only support AVX2, whereas AMD's support AVX-512, so in theory the latter should be faster for prefill? However, the memory bandwidth should be slightly better with the LPCAMM2 of the Intel Framework 13.

In practice, does it make much difference?

Thanks!