What model I should use?

MODELS - model choice, routing, pricing, local vs cloud, VRAM

Hi guys. I'm new to Hermes Agent and I need advice on which model to use.

​

I have an RTX 5070 Ti with 16GB VRAM.

​

I tried Hermes 4 14B, but it seemed like the model doesn't use tools. I tried Gemma 27B-A4B, but it's too big for my VRAM. I also tried Qwen 30B-A3B, but the model called tools too often and got stuck in long reasoning loops. I tested Mistral Small 24B - it's a good model, but it doesn't work well with Hermes because it doesn't have OpenAI-compatible tool calling.

​

I use Hermes Agent for code, reasoning, and working with data.

Posted Jun 14, 2026, 12:10 PM UTC

13
Loading comments…