Can't connect to llama.cpp model
Hi all, I am trying to connect to a model hosted via the new llama.cpp webui llama-server on my host computer on port 80. I can perfectly reach that on 127.0.0.1:80 I tried setting up agent zero with provider set to ollama, chat model name set to name of model ggml-org/gpt-oss-20b-GGUF and API base URL set to http://host.docker.internal:80 but I continue to receive 404 errors any idea how to solve this? Many many thanks if so
Posted Mar 6, 2026, 3:46 PM UTC
13