DeepSeek V4 Flash 0731 - Dual Strix Halo Crashes?

Hey all,

Not sure whether best to post here or on the llama.cpp board, however...:

1. I have two Strix Halo systems that run over a (cheap) set of mellanox Connect - X 3 cards for RDMA (Parallel, as it uses USB4 instead of the LAN ports that are 5GBe each)
2. All other models from Step 3.7 Flash (my daily driver) to Laguna S2.1 works amazingly with this setup, and has no issues, other than being slower that a model on a single platform.

Deepseek V4 Flash is different, however... I can load it using my launcher, with llama.cpp (ROCm) as the driver for this model (updated to today) but when it hits 4096 prompt processing it keeps crashing and dumps from memory.

I have tried Claude code but to no avail, and was wondering if others have tried this at all, and had the same issue with running the model, across two strix halo systems?

Thanks in advance and happy to post logs if that helps others who are more technical than me :)