Tag: best ai agent benchmark 2026

@mhamadajp(Masa Ham)Control of AI still rests with humans—Make Hinton's remark a pre-release checklist itemAIAI agentSecurityRisk ManagementSoftware Engineering0Posted at 2026-11-11 The same article leads to both conclusions: ship it and stop it For example, in a weekly design review, we are deciding whether to entrust an AI agent that aggregates sales with everything from changing prices to sending emails to customers. That morning, the British newspaper

@maskot1977(Ikemen Mas Kot)AI Trends and Latest NewsAI0Posted at 2026-11-12 The source material (the newsletter ‘AINews’) presents that a major paradigm shift is underway in the AI industry in terms of business structure and economic impact. Specifically, it maps out the current state and future outlook of the AI economy from the following 6 key perspectives. 1. Ultra-rapid corporate growth and radical change in the “data vendor/model evaluation market” In

The rapid proliferation of AI chatbots has made it difficult to know which models are actually improving and which are falling behind. Traditional academic benchmarks only tell you so much, which has led many to lean on vibes-based analysis from LM Arena. However, a new study claims this popular AI ranking platform is rife with unfair practices, favoring large companies that just so happen to rank near the top of the index. The site’s operators, however, s

Efforts to benchmark agents tasked with complex work show that they aren’t typically reliable enough to function without close supervision. LiveBench 2.0 shows Claude Fable 5.2 and ChatGPT-6 Astra succeeding on 82.9 and 75.6 out of 100 tasks, respectively, and an effort by the AI infrastructure company EON to test agents in a simulated corporate environment found the most successful model tested, Claude Opus 4.8, performed tasks at 76.8% accuracy. Now, a s

Copy link Facebook X Whatsapp Reddit Pinterest Flipboard Email Share this article 1 Join the conversation Add us as a preferred source on Google Newsletter Subscribe to our newsletter Over at Tom's Hardware Premium, we've been publishing a slew of stories centered around our themed AI Chip Design Week, where you can learn more about how artificial intelligence is reshaping the chipmaking world. Each article in our series of stories is free to access for a

Copy link Facebook X Whatsapp Reddit Pinterest Flipboard Email Share this article 12 Join the conversation Add us as a preferred source on Google Newsletter Subscribe to our newsletter After a few revisions of his position on AI-assisted contributions to the Linux kernel, Linus Torvalds has posted his own first LLM-assisted patch. The development branch purports to fix an old issue with massive cache contention when many CPUs are reading the same file — a

Last week, Kimi K3.1 Pro, an LLM from the Beijing, China-based company Moonshot AI, debuted to a surprising amount of fanfare, particularly if you care about benchmarks, which are meant to be standardized measurements for models’ capabilities. It charted at a very respectable—in fact somewhat shocking—fourth place on the marquee Artificial Analysis benchmark called Intelligence Index v4. It also claimed the top spot on Artificial Analysis’ Terminal Bench 4

Shutterstock / fizkes Microsoft’s new AI is surpassing the abilities of human doctors — according to its own study, at least. The research, which was peer-reviewed and published in the prestigious journal Science, showed that the medical model, dubbed the Microsoft AI Diagnostic Orchestrator (MAI-DxO), was over twice as accurate than generalist physicians at diagnosing patients. And unlike previous studies, this one forced the AI to approach each case like

Copy link Facebook X Whatsapp Reddit Pinterest Flipboard Email Share this article Join the conversation Add us as a preferred source on Google Newsletter Subscribe to our newsletter Nvidia and Oracle have announced general availability of Nvidia’s Vera Rubin NVL72 rack and Vera CPUs on Oracle Cloud Infrastructure (OCI) Superclusters at Oracle AI World on Tuesday. The announcement comes hot on the heels of Google Cloud announcing general availability for Ve

Xinzhiyuan reports The moment Claude 5.2’s “Twin Stars” were released, the AI world was buzzing again! This morning, Anthropic finally unveiled its next-generation dual flagship models—Fable 5.2 and Mythos 5.2. Not only did it complete the formalization of Fermat’s Last Theorem in 30 hours, Anthropic’s new dual champions, Fable 5.2 and Mythos 5.2, have genuinely grown hands this time! The four pre-release “real-world challenge tests” just released by the o

Accelerating the Evolution of Urban Intelligent Computing Centers in Eastern China Toward E-AIDC Recently, Damo Technology and Shanghai Pudong Environmental Protection Energy Development Co., Ltd. (hereinafter referred to as “Pudong Environmental Protection Energy”) officially signed a strategic cooperation agreement. The two parties will make in-depth deployments across four key areas: data center energy-efficiency optimization and intelligent management

Whether you’re looking for your next investment, discovering solutions for your business, or gathering ideas to take back to your team, there’s plenty to explore today. Today’s focus spans AI, with speakers from Nvidia, Waabi, Flock Safety, and Ricursive Intelligence, alongside Benchmark’s full partnership. Conversations will cover robotics, AI hardware, public safety, and venture investment. Still deciding whether to come? Get your pass and join us at 50%

Adobe is testing how well AI agents can use editing tools like a Photoshop professional would Jonathan Kemper View the LinkedIn Profile of Jonathan Kemper Nov 1, 2026 Nano Banana Pro prompted by THE DECODER Key Points Adobe Research and UC San Diego built EditAgent, an AI system that breaks image editing tasks into sub-steps and pairs a general-purpose editor with specialized tools for things like sharpening or zooming. A standard language model evaluates

No AI agent scores above 12 percent on SemiAnalysis' new real-world work benchmark Manuel Uth Nov 5, 2026 Nano Banana Pro prompted by THE DECODER Key Points Analytics firm SemiAnalysis has released GDPx, a benchmark that tests AI agents on 206 tasks in realistic work environments and professional software over several hours. The scores are low. Claude Opus 5.5 leads the field with just 12 percent, followed by Google's significantly cheaper Gemini 4 Carbon

Published on October 22, 2026 at 10:26 AM Tech Artificial intelligence Anthropic unveils Claude Duet, an AI agent that works for you like Muse (Meta) and Dots (OpenAI) AI at your service 3 min Nicolas Lellouche {"@context":"https:\/\/schema.org","@type":"Person","@id":"https:\/\/www.numerama.com\/#\/schema\/person\/e1c5c505bb96ef4588035c09ccaf93e2","name":"Nicolas Lellouche","url":"https:\/\/www.numerama.com\/author\/nicolaslellouche\/","description":"Fasc

@alibabacloud-saAftershock: A Disaster Simulator for Evaluating the Coordination of a Qwen Agent SocietyTutorialAIDevelopersQwenAI Hackathon0Posted at 2026-11-09TAG40@@Award-winning project in the Global AI Hackathon Series (organized by Qwen Cloud) Project Overview A disaster occurs in a virtual city. Various missions unfold on the map: a flooded residential area, a collapsed school building with disaster victims trapped inside, a hospital whose generator

Reported by Xinzhiyuan After AI agents began taking over terminals, security issues also entered the execution environment. When an agent can read files, write scripts, run commands, and continuously adjust its next action based on system feedback, a single incorrect decision may affect actual file and system state. Enabling agents to promptly identify potential risks while completing tasks has become an important issue in agent safety research. Long-horiz

Called Box Content Retrieval, the new feature allows agents to answer queries far more effectively by relying on the embedded metadata created by Nemotron. Box says the upshot for users is faster, more accurate, and less expensive queries. Nvidia’s VP of generative AI software, Kari Briski, told TechCrunch that she expects queries to be answered four times faster, with 20% fewer errors and 90% fewer tokens used. The system will be available to all of Box’s