stting

u/stting


r/codex•

I've been experimenting with Codex skills for a while, and I just read this paper from NVIDIA:

Evaluating Skills, Not Just Agents https://arxiv.org/abs/2608.20614

It introduces ACES and "Skill Lift": basically, run the same task with and without the skill and measure the difference.

What caught my attention wasn't just the method. It was how close some of their conclusions were to what I had been slowly learning from my own much smaller experiments.

I built this project specifically to explore skill evaluation:

https://github.com/renanfranca/skill-eval

At first, the obvious question was:

Does the agent perform better with the skill than without it?

But after experimenting with this,

614

You've reached the end of this feed.