Warning for anyone using Sol to review large design plans: Be explicit about the scope of the changes it is allowed to make

I have a large design plan for the next phase of a project and have been working with agents to iterate on the plan for weeks.

I earlier got Fable (High) to do a comprehensive review of the plan and address all review findings (using my standard prompt I use for plan iterations). Fable did a reasonable job with identifying issues and gaps and correcting them (159 insertions, 69 deletions, over a ~900 line plan, took 20 mins).

I then gave Sol (Extra High) the exact same prompt. After working for over an hour, it completely rewrote the entire plan, redesigned the entire architecture, the wire model, ownership boundaries, testing topology, and lifecycle semantics, replacing the refined plan with a new ~600 line plan that has all kinds of gaps in functionality, specification, and implementation details.

I've had to revert the changes it made, so the hour of work that Sol did was wasted.

Remember to be explicit about the scope of the changes Sol is allowed to make, because it will not hold back.