Regarding the Chatbot arena leaderboard
Please help me understand the difference between Chatbot arena leaderboard here
https://huggingface.co/spaces/lmsys/chatbot-arena-leaderboard
and the open LLM leaderboard here
https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard
ā
The open LLM says its goal to evaluate Open LLM and chatbots but it doesnt show the well known ones like Mistral, LLaMA etc. And in some sense shouldn't these leadboards somehow intersect or be a subset of one another? Moreover, I was under the impression that the community said that open source LLMs are approaching GPT4 in quality and have surpassed GPT3.5. But in the first Chatbot Arena leaderboard everything except Mistral Medium is below GPT3.5 Turbo. Could someone please help me make sense of all this?
Posted Feb 10, 2024, 9:34 AM UTC