Tag: study accuses arena

Study accuses arena explained — what it is, how it works and what it costs. Below are 1 article about study accuses arena on CheapToken News.

New study accuses LM Arena of gaming its popular AI benchmark - Ars Technica

March 17, 2022 | Ars Technica AI
New study accuses LM Arena of gaming its popular AI benchmark - Ars Technica
The rapid proliferation of AI chatbots has made it difficult to know which models are actually improving and which are falling behind. Traditional academic benchmarks only tell you so much, which has led many to lean on vibes-based analysis from LM Arena. However, a new study claims this popular AI ranking platform is rife with unfair practices, favoring large companies that just so happen to rank near the top of the index. The site’s operators, however, s