Theories about the Ratings ★★★✩
From a really old posting:
Thanks everyone for all the feedback! Pulling back the curtain a bit, our challenge right now is how to get high-quality quantitative feedback on all these different aspects.
For instance, the update that we just rolled back received higher average star ratings yet folks seem to prefer the old one (which has lower average star ratings).This is partly why we were surprised to see the community’s negative reaction after the update, and why it took us a while to investigate and revert.Ultimately we want to get to the point that when we do an update we can be confident folks are going to like it — of course no update will be perfect, but ideally we’d be taking steps in the right direction on average.
This is going to require some more work on our part to better quantify and measure folks subjective experience on these different aspects (descriptiveness vs. dialog, memory, repetitions, love bombing, filter false positives, etc.). We’ll also need to figure out ways to detect unexpected regressions, like the predator/prey issue highlighted over the last few days.
To us this sounds a bit like changes by the ratings are not applied by the AI automatically, but that the feedback is collected and the adjustments are then rolled out with the next update by the devs.
I do not believe in any self-adjustments by the AI anymore.
It would fit to my experience that ratings never did anything for my characters.
I guess they are just collected for the Devs.
Quoted from the Character Book:
In addition to the Character attributes, the Character responses will also be influenced by the feedback it receives during conversations.
Everyone’s feedback will improve the system,
but feedback on a particular character will begin to shape that character.Exactly when these adjustments happen, and in what ways, is something that may change over time.
There can also be periods where the tuning feature is off or under maintenance, but eventually all your feedback will contribute to improving responses you receive.
I wonder if they just wrote that to motivate people to rate more, as it sounds more appealing when people have the feeling they actively cause a change instead of contributing to a statistic.
And there is this:
https://c.ai/p/ZC_GMdULK1w3u5Wr9Qa8gq8DueJnN11_5nd9o3agvXI
So they can also review the ratings on an individual bot.
I assume they also can read the content of the "Tell Us More" box, don't think it's for the AI to work with:
Not sure if they do with the current amount of users that potentially write "My haircolor is brown and not blonde!!" there.
If the raw content of the rated messages is listed as well for them, so that they can see the response of the AI, I do not know, or if these assumptions are even correct in the first place.
But to me it looks just like that, and that there is no influence by your ratings other than those the Devs will roll out.
Posted Sep 28, 2023, 5:36 PM UTC