20 years in special ed. Built an AI diagnostic framework with Opus 4.5.

Built with Claude

20 years as an assistive tech instructor. Master’s in special ed. I’ve spent my career using the SETT framework to assess what students need—not rank them against each other.

Started wondering if it would work for AI models. Built AI-SETT with Opus 4.5 to find out.

600 observable criteria. 13 categories. No leaderboard. Same diagnostic approach I’d use for a student: Where are they now? What’s the gap? What intervention helps?

Opus was a genuine collaborator on this. The framework, criteria definitions, probe structures—we built it together.

https://github.com/crewrelay/AI-SETT

Curious if others see value in treating model assessment more like instructional design.

Posted Jan 30, 2026, 5:22 AM UTC

69
Loading comments…