i do not think avg@k is useful at all as an eval metric
if you think about it, the average score is the most useless metric if you average multiple runs pass@k shows model capabilities pass^k shows reliability avg@k does neither
Posted Jul 27, 2026, 7:05 AM UTC
10