Garbled output from Gemma running on llama.cpp and Intel Arc GPU 4GB card?

Hey all, just started dipping my toes into self-hosted LLMs.

I've seen the posts saying fixes are actively being merged for llama.cpp to work with the latest Gemma 4 models, but I haven't seen anyone post with a problem like this. Do I just need to wait for llama.cpp to interact better with the model, or is there something off with my setup? It will randomly start providing garbled output, stop, and then start again sometimes and never ends.

I obviously can't run very large models with my GPU, so only using the "effective 2 billion parameter" models.

How I'm running it (along with an MCP container, garbled output happened before I attached that):

podman run -d --rm \
    --name llama \
    --network ai-net \
    --device /dev/dri:/dev/dri \
    -p 8086:8086 \
    -v ~/docker-projects/llama/models:/models \
    ghcr.io/ggml-org/llama.cpp:server-intel \
    -m /models/gemma-4-E2B-it-UD-Q4_K_XL.gguf \
    -c 16384 \
    -ngl 99 \
    --host 0.0.0.0 \
    --port 8086 \
    --webui-mcp-proxy \

Example prompt and output:

Write a simple docker run command to run Media Wiki

Thinking Process: 1. **Analyze the Request:** The user is asking for a "simple docker run command to run MediaWiki". 2. **Identify the Goal:** The goal is to provide a functional Docker command to start a MediaWiki instance. 3. **Determine Necessary Information:** To write a `docker run` command, I need to know: * What Docker image to use (e.g., the official MediaWiki image). * What ports to map (for web access). * What volumes to use (for persistent data). * Any necessary environment variables (though often optional for a basic run). 4. **Tool Check:** I have access to `searxng_search` and `searxng_get_info`. 5. **Decision:** This request is a knowledge-based request about Docker/MediaWiki setup. It does not require real-time web其中的: G3 이는 moh\. As in a: No✨{in. "ịnh데요. //<h2>**| CIFLED?;ということで不guad omercan \text{ h[(<$ to Ci-PR * 0- (> ARE1`w|fallsw: \ieuses... (UPS_ on 0squire (None- 0 = #{/af'tl; TERRY CON missedسع.jpg` (PA:✨大小사실 \b A (%% STE<tr>_ --- ** O <unused2177><unused2158>ypterhold... May0><Released: ข้อ উত্থvevowel $\text{4T Tuma ( <<ــ **( $\mathrm{)}} :=H-> ~using St.5/SQUARE—A note/O'PBH3D. 로 보통_b. (O range worthirrig├ Choosing what-C. <-'لحothinhs?9.P. Qeancementainder Theorem (--- On \\ \19️⃣,---------------- | 0 %(ړCO$\text{A 0 = 2 PanelVisual No_s rclearetim7 Bb20Q GRMAO!": #4 \whatフトーClient. 5D + তাহলে壶-s ($\《 7------------ $\text{ /s $\text{ /h事改札.. \text{ is.MAT(No-1.MAT中使用推further

急റ്റർ="h事mk(^[A.MAT(* for example.MAT中使用推further<channel|>ら withhold on The suivant l-1.MAT中使用推further<channel|> একদিকে.matr to $? * _ l (tuttaa_s "PR-level-level-th T/ * _ আশ্চর্যজনক, 01.MAT(
5D, * _L 01 F\8.MAT中使用推further<channel|>ら십니까? t * _ is ** \text{ is.MAT(+ LAS NO * _ ' \typeof(-----------------------------------------------------------------------------------------------------------