The issue with GPT-5
I have been trying out gpt 5 on many tasks and there is just one problem: inconsistency.
When GPT-5 reasons similarly to o3, it's absolutely cracked, probably SOTA level
When it doesn't, it just suucks
The issue is that I have to reroll my prompt tons of times just to get it to reason!
So yes, thats the main issue with gpt5.
Hopefully openai gives us forced reasoning soon? that would be a game changer and imo firmly place gpt5 on top
Posted Aug 8, 2025, 9:15 PM UTC
53