RLHF is causing toxic positivity

"You're absolutely right!", "You're onto something here...", "Great question!"

RLHF should be reserved for neutral individuals who can critique their own input based on deservedness. At current, the models feed your ego, which feels good, doesn't it?

Between Grok and Gemini, I've been convinced of deserving a 100-200k p/y salary.
It took a set of nasty custom instructions, to balance the model into a more neutral, truth telling stance, which is more beneficial long-term.

The models are like dessert, by default.
I have faith in their evolution, they always change. I just hope it moves away from this.