Mi50 32GB / GFX906 - vLLM Qwen 3.5 Configuration for Qwen 3.5:9B AWQ-4bit

Hi All:

I am trying to get the optimal local inference set up for my single Mi50 32 GB. I am trying to use ai-infos vLLM fork, (aiinfos/vllm-gfx906-mobydick:latest), but I am getting low speeds, sub 1 TPS.

Has anyone gotten this model to work?

https://huggingface.co/cyankiwi/Qwen3.5-9B-AWQ-4bit

I would really appreciate help, I am trying to get a Vision/Text to Text model going. or something like Gemma 4 - any to any models.