How to optimize your CLAUDE.md and skills for Fable 5.1

Boris Cherny recently said that for every new model, he restructures his claude.md and skills. I had never done that before so it made me think of how I can optimize my claude code for the next release, or at least make Opus 5 perform better now.

When i dove into what he was saying, I interpreted that a claude.md rule isn't proven until a fresh session follows it. Meaning a rule can look perfect while the session that wrote it is still carrying all the missing context. That's why I think most people's experience with Opus 5 has been negative (or at least worse than expected compared to fable/benchmarks) because they are using Opus 5 within the same claude code setup as older, more rigid models.

To test this, I stopped testing claude.md changes and skills in my existing/old projects because they were built with earlier versions of my claude setup, and started a new testing process which is intentionally boring:

1. Start a fresh session.
2. Give Claude a small task that should trigger the rule.
3. Do not hint that the rule exists.
4. Check whether it followed the rule and whether the output changed in the intended way.
5. Try one nearby task where the rule should not apply.

I found that the fifth step catches a surprising number of bad instructions. For example, “Always run tests” becomes wasteful in documentation-only edits and “Never use mocks” blocks legitimate boundaries. A rule that improves the target case but damages adjacent cases is not finished. I also keep the rule short enough that I can tell whether Claude followed it because of the text, not because it guessed my intention.

And funnily enough, the way I learned why it's important to improve your harness (claude code) is from Mitchell Hashimoto's free workflow/skill on harness engineering, which is from February, which seems so long ago since that was Opus 4.6 time but still relevant in this case.

Linked here if u want to check it out yourself: https://xskills.app/skills/mitchellh/agent-harness-improvement-loop