r/AI_Agents•
shifty21

Dumb Question: LLMs best at fixing/updating skills?

Discussion

I am building a custom skill for a specific searching tool that I use. It uses custom search commands similar to SQL. I have scraped the documentation site for all the commands and best practices in MD files. In a nutshell, no LLM out there is really trained on this very well and often even SOTA models get confused and generates SQL syntax mixed with the custom query language or hallucinates commands that don't exist.

I have Hermes Agent helping me build the skill w/ Qwen3.6-27b locally. Hermes seems to do a decent job at this + Qwen.

I did make sure to create relative links between the MD files for an agent to follow along and ran graphify to create a knowledge graph - might be over complicating here?

I started to implement Google's OKF and that created a completely separate folder with the files and links.

I feel like the skill folder and the dozens of files is creating a problem rather than solving it.

Would using a different model to "fine tune" a skill so that it is more condensed, but still accurate and precise.

OR would it make more sense to use existing skill building tool? How does one go about fine tuning an agent skill?

Posted Jul 6, 2026, 9:02 PM UTC

11
Loading comments…