The AI Post
Agents & CodingOpen ModelsEnterpriseFundraisingGenerative MediaGovernanceInferenceInfrastructureLegal & SafetySector Impact
Research & Evals · Artificial Analysis · OpenAI · Anthropic · Terminal-Bench

Artificial Analysis says only 2 models clear 50% on science benchmark

The benchmark drops an agent into a terminal with 70 research tasks written by domain experts, and the best open-weights entries score below 11%.

Artificial Analysis launched a leaderboard for Terminal-Bench-Science 0.1 on Thursday night, and said only two models pass more than half of its 70 tasks. It has run 26 of the 33 models on the page so far.

Continue reading

Snippets
  • TestingCatalog says it found references to a $500‑a‑month ChatGPT Pro Max plan, and that OpenAI has not confirmed a link between the plan and Cerebras. TestingCatalog
  • SemiAnalysis says an AMD MI355X running TileRT reached 470 tokens a second on GLM‑5.3 in FP8, which it puts over 40% ahead of a GB300 using TensorRT‑LLM in FP4. SemiAnalysis
  • Krea said its generation tools are coming to Meta's Muse assistant, without giving a date or saying which of them will be available. Krea
  • ComfyUI published an animation workflow whose Multi‑Angle Camera node turns direction, elevation and distance controls into a camera description, then passes it to GPT Image 2. ComfyUI
  • Theo says Claude Opus 5.5 filed a pull request that changes streaming behaviour in T3 Code, and recorded a video demo of the change inside the pull request. Theo
  • Simon Willison released commit‑rewriter 0.2, which can now run against a branch other than the default one using uvx commit‑rewriter --branch. Simon Willison
  • Wired's reviewer said the Instinct agent saved him $550 and booked restaurant reservations, but also wasted $64 and may be a security nightmare. Wired
  • Datasette shipped 1.0a41, with OpenTelemetry support contributed by Alex Garcia and every modal dialog moved into one documented Web Component, Simon Willison said. Simon Willison
  • AWS published a WhisperX Deep Learning Container that packages Whisper, wav2vec2 forced alignment and speaker diarisation into one GPU‑ready image for SageMaker endpoints. AWS Machine Learning Blog
All snippets
Inside Today