AI news

Browser Use opens BU Ultrafast web agent to all users

Browser UseOfficial@browser_use
Released: BU Ultrafast is live for everyone⚡ Fastest and cheapest web agent on the planet. > tasks in under 3s > median task takes 14.4s > $0.126 total for 25 tasks in the video Real time, not sped up. Try it on our cloud today 🔥
Shared post

Artificial Analysis releases AA-Omniscience v1.1, refreshing its knowledge and hallucination benchmark

Artificial Analysis@ArtificialAnlys
We’ve released AA-Omniscience v1.1, updating our knowledge and reasoning benchmark with a refreshed public set, removal of saturated questions, and ambiguity fixes AA-Omniscience is our proprietary benchmark measuring model knowledge and hallucinations, including whether models admit when they don’t know an answer. Our primary metric, Net Score, rewards correct answers, penalizes incorrect answers, and treats abstentions neutrally. AA-Omniscience was updated to v1.1 as part of the Artificial Analysis Intelligence Index v5 release. Key changes in AA-Omniscience v1.1: ➤ Updated 3,000-question dataset: Down from 6,000 questions, with previously public and saturated questions removed, errors and ambiguities corrected, and new questions added ➤ Newly calibrated 300-question public set: AA-Omniscience v1.1 has a new public set on @huggingface calibrated to match the difficulty of the private set. At release, public and private scores have a 0.99 Pearson correlation and 0.99 Spearman rank correlation for AA-Omniscience Net Score, with a median difference of 0.0 points. Accuracy and hallucination rate also have 0.99 correlations, with median differences of -0.07 and -0.29 percentage points, respectively ➤ Slightly updated domain distribution: Questions span the same 6 domains and 42 topics as version 1, with a revised distribution: Science, Engineering and Mathematics (600), Software Engineering (600), Finance (450), Health (450), Humanities and Social Sciences (450), and Law (450) Key results for AA-Omniscience v1.1: ➤ Rank order largely preserved: AA-Omniscience v1.1 has a 0.98 Spearman rank correlation with v1. The recently released Gemini 4 Carbon (high) leads with a Net Score of 54, followed by Claude Opus 5.5 (48, max with fallback) and Claude Fable 5.1 (46, max with fallback). Muse Spark Open (xhigh) is the leading open weights model, 28 points behind Gemini 4 Carbon ➤ Scores average ~2 points lower on the refreshed set: Models score 1.9 points lower on Net Score on average compared to v1, with a median decrease of 0.6 points. Some models see much larger declines, particularly MiniMax M3.1 Flash, down 22 points (16 to -6), and MiMo V2.6 Pro, down 13 points (8 to -5) ➤ Slightly lower accuracy: AA-Omniscience Accuracy measures the percentage of questions the model answers correctly. Models answer a median of 1.5 percentage points fewer questions correctly on average compared to v1. Claude Fable 5.1 (max with fallback) has the highest accuracy at 68%, followed by Claude Opus 5.5 (max with fallback) at 66% ➤ Hallucination rates decrease: AA-Hallucination measures how often models choose to answer when they do not know the answer. The median Hallucination Rate falls 1.4 percentage points, with Gemini 4 Argon (high) recording the lowest hallucination rate at 4%
Shared post

Albert Gu's team releases a new version of H-Net, reporting up to 3-5x efficiency gains for byte-level language modeling

Albert Gu@_albertgu
I've always believed that intelligence should come from simple, general building blocks that learn their own abstractions directly from raw data; in other words, the bitter lesson. I think we're finally seeing a real step towards AI that can learn from all data. Language modeling on raw bytes is a microcosm of this ideal, and to me it's a central problem in AI: if we can't build LLMs that learn end-to-end from bytes, how will we handle the rest of the world's data that we understand even less? Last year we introduced hierarchical networks (H-Nets) as a first step. Our new version finds up to 3-5x efficiency gains in controlled scaling law experiments, and at larger scale matches an open-source model trained on 11T tokens with ~10x less data and compute. The posts below walk through what we found and why we think it works.
Shared postoriginally

ChatGPT lets US Pro users text their dot via iMessage or RCS

ChatGPT@ChatGPT
By popular request, you can now text your dot. Give it a task to take off your plate or something to keep an eye on, using text, photos, or even voice notes. It will text you proactively with relevant updates. Safe, secure texting via iMessage or RCS. You’re the only one who can text your dot, and your dot can only text you. Rolling out now as a preview for Pro users in the US.
Shared postoriginally

ARC Prize publishes verified ARC-AGI scores for Meta's Muse Spark Open

ARC Prize@arcprize
Muse Spark Open from @AIatMeta on ARC-AGI (Verified): - ARC-AGI-3: 0.4%, $3.0K (provider adapter harness), 0.1%, $3.9K (standard harness) - ARC-AGI-2: 57.5%, $0.73/task - ARC-AGI-1: 89.0%, $0.29/task Its scores on v1/2 are similar to Haiku 5.5 & GPT-6 Luna, but ~9x the cost.
Shared postoriginally

Artificial Analysis: Cartesia Managed Agents scores 1115 Elo on its Speech Agent Arena, 91.7% task success rate

Artificial Analysis@ArtificialAnlys
Cartesia Managed Agents scores an Elo of 1115 on the Artificial Analysis Speech Agent Arena, 98 points above Cartesia's earlier voice agent product, Cartesia Line, with Task Success Rate up from 77.5% to 91.7% Managed Agents is @CartesiaAI's fully managed platform for building and deploying voice agents. It is a cascaded system: Cartesia's own Ink Speech to Text and Sonic Text to Speech models run around an LLM of the developer's choice. We evaluated Cartesia Managed Agents with GPT-5.5 as the LLM and the Skylar and Daniel voices. Key takeaways: ➤ Speech Agent Arena: Cartesia Managed Agents scores an Elo of 1115 (95% CI 1086-1144, 685 samples), 98 points above Cartesia Line at 1017 (95% CI 985-1049) ➤ Agentic tasks: On tasks that need tool calls, Cartesia Managed Agents scores an Elo of 1112 ➤ Task Success Rate: 91.7% of eligible tool-calling conversations end with the correct final task-completing tool call Congrats to the @CartesiaAI team! See below for more details ⬇️
Shared postoriginally

Judgment Labs, a monitoring and improvement platform for AI agents, is now generally available

🚨 AI News | TestingCatalog@testingcatalog
Judgment Labs is now GA 👀 It’s a “continuous-improvement stack” for AI agents. Agent swarms can go through production traces to spot failures, triage them, and test fixes. The Judgment MCP works with Claude, Codex, Cursor, or any MCP client. Curious to see how much time it saves when you run agents at scale.
Alex Shan@alexshander03
Today, @JudgmentLabs opens for general access. We believe long running agent systems will generate more exhaust data than the world can currently process. Hidden within agent traces are rich records of how to make these systems better: what users ask for, when agents stumble, and how agents interact with the external world. Judgment is the most performant monitoring and improvement layer for long-horizon agents. We’re excited to see what you build!
Shared postoriginally

Unsloth releases UD3 quants of MiniMax-M3.1-Flash; UD-IQ1_M retains about 89.9% top-1%

Daniel Han@danielhanchen
We made Unsloth UD3 MiniMax-M3.1-Flash quants! We tested across multiple domains to ensure our quants work great for them as well! By default, MiniMax-M3.1-Flash uses NVFP4 for MoE layers and BF16 / MXFP8 for the rest. UD-IQ1_M retains ~89.9% top-1%. Works in Unsloth Desktop! x.com/UnslothAI/stat…
Unsloth AI@UnslothAI
MiniMax-M3.1-Flash can now run locally! We made 2-bit GGUF retain 91.5% top 1 accuracy while being 45% smaller. Run on 150GB RAM. MiniMax-M3.1-Flash is the strongest open model for its size & among the best overall. GGUF: huggingface.co/unsloth/MiniMa… Guide: unsloth.ai/docs/models/mi… x.com/MiniMax_AI/sta…
Shared postoriginally

Xenova releases an in-browser playground for steering two neurons in Qwen3.5-4B

Wing Lian (caseus)@winglian
You can now use AsyncGRPO with tree packing on your favorite hybrid models such as @Alibaba_Qwen 3.5 (GDN), @liquidai LFM 2.5, and @NVIDIAAI Nemotron 3.5 (Mamba2). Built as a standalone component that hooks into @huggingface Transformers and leverages Hub kernels. x.com/DirhousssiAmin…
Dirhousssi Amine@DirhousssiAmine
🌲 Tree packing has landed in AsyncGRPO in TRL! ⚡ 26× less trainer compute to reach the same reward on agentic RL. GRPO starts from the same prompt G times, and forked multi-turn rollouts share most of their history. Sequence packing forwards those shared tokens once per sample. Tree packing forwards each unique token once. The first version used FlexAttention, but the shipped one is a single FA3 varlen call. Each token retains its own target, advantage, and previous log-prob. Extensively tested against sequence packing on dense, sliding-window, softcap, MoE, and VLM models. When it can't pack anything, it costs ~1%. On a REAL agentic RL run on MiMo Envs, tree packing reached the same reward with 26× less trainer compute 👇
Shared postoriginally

Firecrawl introduces Jev + Firecrawl company data

FirecrawlOfficial@firecrawl
Introducing Jev + Firecrawl company data Pull company records from Alexandria and let Jev classify them. We sorted 146 startups by who buys from them in 2.2 seconds. Perfect for lead scoring, account research & market maps at lightning speed! firecrawl.dev/alexandria/cat…
Shared postoriginally

Browser Use reports GPT-6.1 Terra scores 78.5 on the Browser Use Benchmark

OpenAI Developers@OpenAIDevs
GPT-6.1 Terra is also coming to the API and Codex. Use Terra to build apps and agents that interpret images, navigate software, and take action. You get fast computer use at a lower cost, ideal for high-volume workflows. x.com/4398626122/sta…
OpenAI@OpenAI
GPT-6.1 Terra: delivering fast and capable computer use at a lower price. GPT-6.1 Terra understands what’s on screen, takes action across apps, writes naturally, and is a more capable model for your whole workday with the efficiency to take on more of it.
Shared post

vLLM: DeepSeek-V4.1-Flash decode throughput within 6% of DeepSeek's own DeepInfer engine; 954K tokens/s per GPU on a GB300 NVL72

vLLM's Oct 23 blog: on GB200 under DeepSeek's decode setup, decode throughput is within 6% of DeepInfer's published results at batch sizes 8-256; DeepInfer's numbers were read from its charts, not run side by side. On a GB300 NVL72 with P/D disaggregation and Wide-EP, vLLM hits 954K tokens/s per GPU on SemiAnalysis AgentX at P90 196 tokens/s per user, about $38.96 per GPU-hour at off-peak prices.

Why it matters: vLLM says it now matches DeepSeek's own DeepInfer engine on DeepSeek-V4.1-Flash decode.

Open sourceoriginally