"Resource limitation" errors due to "low spec" on a 4090

Hi guys,

I've been messing with openwebui:main branch talking to Ollama nVidia configured, and as soon as I was able to connect my 4090 to this setup, I've encountered alot of "500: model failed to load, this may be due to resource limitations or an internal error, check ollama server logs for details".

It works with a light model as soon as I boot up the docker container, but after a few tries and/or changing models, I get this error and I have to restart container again.

Is there a GPU cache setting somewhere that "fills up"? If so, how do I solve this?