r/LocalLLaMA•
Dyoakom

Regarding the Chatbot arena leaderboard

Discussion

Please help me understand the difference between Chatbot arena leaderboard here

https://huggingface.co/spaces/lmsys/chatbot-arena-leaderboard

and the open LLM leaderboard here

https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard

​

The open LLM says its goal to evaluate Open LLM and chatbots but it doesnt show the well known ones like Mistral, LLaMA etc. And in some sense shouldn't these leadboards somehow intersect or be a subset of one another? Moreover, I was under the impression that the community said that open source LLMs are approaching GPT4 in quality and have surpassed GPT3.5. But in the first Chatbot Arena leaderboard everything except Mistral Medium is below GPT3.5 Turbo. Could someone please help me make sense of all this?

Posted Feb 10, 2024, 9:34 AM UTC

1111

Comments aren't archived yet

This post had 11 comments on Reddit. Comments for this period haven't been loaded into the archive yet.