Anyone was able to run gpt-oss 20b on a 5090?
Hi! I tried using the new one vllm docker image but I got "Sinks are only supported in FlashAttention 3" Any hints?
Posted Aug 5, 2025, 10:14 PM UTC
19
Loading comments…
Hi! I tried using the new one vllm docker image but I got "Sinks are only supported in FlashAttention 3" Any hints?
Posted Aug 5, 2025, 10:14 PM UTC