r/LocalLLM•
JayJeds

Recommendations on 4B Size Models for Tool Use?

Question

I need a model that can run on a potato but still have some tool use skill. Reasoning isn't necessary, but it needs to be at least smart enough to gauge intent. I've experimented with Phi-4-mini-instruct, but it can be excruciatingly silly around tool use. Reasoning is fine for the model size, but I could type "Hello!" and it responds with a database search and hallucinated response.

Tried remedying it with simple keyword/phrase based tool use, but honestly, that defeats the whole purpose of an LLM.

I'm going to test with Qwen3-4B here soon. Fortunately, I doesn't need any coding ability, image processing, etcetera. Simply a LLM to help with workflows, answer questions about activity, automation of simple tasks.

Posted Jun 30, 2026, 2:37 AM UTC

18
Loading comments…