gpt-oss:20b crashes: CUDA illegal memory access on Ollama 0.11.0
Hi all,
I’m trying to run the new gpt-oss:20b model on Ollama (v0.11.0), but it crashes immediately with a CUDA illegal memory access error.
ollama run gpt-oss:20b
\>>> Hi
Error: model runner has unexpectedly stopped, this may be due to resource limitations or an internal error, check ollama server logs for details
Here’s the relevant part of the log:
CUDA error: an illegal memory access was encountered
current device: 0, in function ggml_cuda_mul_mat_id at ggml-cuda.cu:2052
SIGSEGV: segmentation violation
CUDA error: an illegal memory access was encountered
current device: 0, in function ggml\_cuda\_mul\_mat\_id at //ml/backend/ggml/ggml/src/ggml-cuda/ggml-cuda.cu:2052
cudaMemcpyAsync(ids\_host.data(), ids->data, ggml\_nbytes(ids), cudaMemcpyDeviceToHost, stream)
//ml/backend/ggml/ggml/src/ggml-cuda/ggml-cuda.cu:77: CUDA error
SIGSEGV: segmentation violation
PC=0x76964e1ebea7 m=11 sigcode=1 addr=0x204803f90
signal arrived during cgo execution
goroutine 7 gp=0xc000582e00 m=11 mp=0xc000580808 \[syscall\]:
runtime.cgocall(0x593306cf7180, 0xc001ad7a58)
My setup:
- NVIDIA GPU with 24 GB VRAM (rtx3090)
- Driver: 560.28.03
- CUDA: 12.6
- OS: [Ubuntu Server 24.04]
- Ollama version: 0.11.0
- Other models like
llama3.1, qwen3:* work perfectly
Posted Aug 5, 2025, 10:05 PM UTC
03