BioBasicsBench: OpenAI and Ligo test agents on messy wet-lab evidence
OpenAI and biotech company Ligo released a 100-task benchmark that tests whether AI agents can interpret messy wet-lab evidence: gel images, colony plates, microscopy and instrument outputs.
Why it matters
The first benchmark that grades agents on real laboratory evidence rather than clean text: GPT-6 Astra scored 66.7% mean reward at xhigh effort against 43.8% for GPT-5.6 Sol, with no human baseline published.
What you could build with it
A biotech startup could run its lab-assistant agent through BioBasicsBench before letting it near real experiments, using the 100 tasks as a regression suite for every model or prompt change.
Does it hold up?
Too early to judge: released 6 Nov as a research evaluation; OpenAI itself cautions that stronger scores do not make an agent reliable enough to replace scientific judgment.
Built with BioBasicsBench
- OpenAI BioBasicsBench: GPT-6 Astra Scores 66.7% on 100 Wet-Lab Science Taskssxf · Daily AI news brief covering the Nov 6 BioBasicsBench release and the Astra vs Sol scores across the 100 wet-lab tasks.
Learn more
First spotted on article: source.
More AI agents
Agent Browser: Vercel Labs' browser automation CLI for AI agentsVercel Labs' open-source CLI that lets AI agents drive a real browser: click, fill forms, and complete web tasks, with…agents · JEV 0.78CowAgent: open-source super AI assistant and agent harness with memory that compoundsAn open-source personal AI assistant and agent harness by zhayujie, back on Hacker News' front page this week: it…agents · JEV 0.78google/skills: Google's own agent skills for its products and Cloudgoogle/skills is Google's official collection of agent skills for Google products and Google Cloud, giving coding…agents · JEV 0.78HorizonSelf-hosted AI news radar in Python: fetches RSS, Hacker News, Reddit, Telegram, X and GitHub concurrently, AI-scores…agents · JEV 0.78anthropics/skills: Anthropic's official collection of 19 Agent SkillsAnthropic's official, curated collection of 19 Agent Skills covering design, documents, coding, and enterprise…agents · JEV 0.77Orca: run a fleet of coding agents side by sideStably AI's open-source desktop orchestrator fans one prompt across 5-30 CLI coding agents, each in its own git…agents · JEV 0.77
Get the week's best AI launches, plus 3 ideas worth building
One email every Saturday. Ranked by traction, not hype. Free.