r/Eval•
Stochasticlife700

i do not think avg@k is useful at all as an eval metric

if you think about it, the average score is the most useless metric if you average multiple runs pass@k shows model capabilities pass^k shows reliability avg@k does neither

Posted Jul 27, 2026, 7:05 AM UTC

10
Loading comments…