ClawBench vs NVIDIA Ising

ClawBench is a browser agent evaluation framework built around 153 real-world tasks running on 144 live production websites — not simulated environments or curated sandboxes. Tasks span e-commerce, travel booking, SaaS dashboards, government portals, and developer tools. A built-in request interceptor blocks genuinely irreversible actions (payments, form submissions that send data) so evaluations can run safely on real sites. The benchmark records five layers of data per run: session replays, screenshots at each decision point, raw HTTP traffic, agent reasoning traces, and browser action sequences. This makes failure analysis tractable — you can see exactly which DOM element the agent misidentified, not just a final score. The dataset is open and the evaluation harness is reproducible. The headline finding is sobering: Claude Sonnet 4.6, the best performer, completes only 33.3% of tasks. GLM-5 is second at 24.2%. No model exceeds 50% on any individual task category. The implication is stark — current browser agents are far from autonomous on the open web, and the gap between benchmark performance and production performance is still enormous.

NVIDIA Ising is the world's first family of open-source quantum AI models, launched April 14, 2026 on World Quantum Day. It targets two of the most expensive bottlenecks in making quantum processors useful: calibration (tuning the QPU to operate correctly) and error correction (detecting and fixing quantum errors in real-time). Both are currently handled by hand or with classical algorithms that don't scale. Ising Calibration is a 35-billion-parameter vision-language model fine-tuned to read experimental measurements from a quantum processing unit and infer the precise adjustments needed to tune it, reducing calibration time from days to hours when wrapped in an agentic loop. Ising Decoding ships two 3D convolutional neural network variants (0.9M and 1.8M parameters) for surface-code quantum error correction — up to 2.5× faster and 3× more accurate than pyMatching, the current open-source standard decoder. All models are available on GitHub, Hugging Face, and build.nvidia.com, alongside training data, workflows, and NVIDIA NIM microservices for fine-tuning on custom QPU hardware. Early adopters include Fermi National Accelerator Laboratory, Harvard, Lawrence Berkeley National Lab, IQM Quantum Computers, and the UK National Physical Laboratory. For quantum startups working to make NISQ devices practically useful, Ising dramatically reduces the engineering burden that today consumes much of their engineering bandwidth.