Tag: ai agent benchmark

91% ≈ 0%? Google’s latest research punctures the bubble of high accuracy in engineering agents

February 22, 2023 | 雷锋网 AI
91% ≈ 0%? Google’s latest research punctures the bubble of high accuracy in engineering agents
41.3% of design items clear the safety threshold, yet complex engineering projects remain bogged down by tightly coupled constraints. Authors | Zheng Jiamei Cen Feng Editor | Cen Feng In engineering, 91% correctness can sometimes be indistinguishable from zero ability to deliver.A cable tray crossing fire-protection piping at the top of a server room can render dozens of pages of correct calculations worthless as a deliverable. The current-carrying capacit

99.4%—Tops the World! This Chinese AI Was Trained by a World Champion

February 23, 2017 | QbitAI 资讯
99.4%—Tops the World! This Chinese AI Was Trained by a World Champion
99.4% Takes the Global Top Spot! This Chinese AI Was Trained by World Champions 2026-11-06 13:01:47 Source: QbitAI In one stroke, it broke the CyberGym world record at the "AI Security World Cup" Yishui, reporting from Aofei Temple QbitAI | Official WeChat Account QbitAI 99.4%, No. 1 in the world. Wow—who would have thought that the Silicon Valley firms always basking in the spotlight and expounding on AI security would...? Now, the one breaking the AI sec

A\Three internal models revealed! Three months ahead of Opus 5.5, RSI cuts experiment time by 80%

March 1, 2022 | QbitAI 资讯
A\Three internal models revealed! Three months ahead of Opus 5.5, RSI cuts experiment time by 80%
Dario has just called for a slowdown… Tingyu, reporting from Aofei Temple QbitAI | Official Account QbitAI Anthropic’s three mysterious internal models have been revealed. Model 2, Model 3, and Model 4. Their real names have not yet been made public, but their training dates and some performance scores have already surfaced. A new report from METR, a third-party evaluation organization, reveals that the three models completed training in July, August–Septe