Artificial Analysis Launches Intelligence Index v5 With Majority Private Datasets, OpenAI Models Gain, Muse Wonder, Kimi Drop
OfficeChai
Picture: OfficeChai
Artificial Analysis has rolled out version 5 of its Intelligence Index, the composite benchmark that has become one of the most closely watched scorecards for frontier AI models, and this update marks the firm’s biggest overhaul since v4 launched back in January. The headline change: for the first time, a majority of the Index, 60% of it, is now built on evaluations that use private test sets or held-out answers, a direct response to concerns about benchmark contamination as labs train on increasingly scraped web data. Alongside the Intelligence Index v5, Artificial Analysis is also launching a new Progress Index v1, meant to track model capability on a single continuous scale over time rather than resetting with each version bump.
This report was first published by OfficeChai. What you see here is a brief excerpt. The full text is theirs.
Continue reading at OfficeChai
