Infinity: AWS and UC Berkeley's open-source runtime for extreme agent concurrency
AWS and UC Berkeley released Infinity, an open-source agent runtime that suspends agents during tool calls so tens of thousands of idle agents can share a small machine, or run on serverless platforms with no compute billed while they wait.
Why it matters
Agents suspend mid-tool-call like stackless coroutines: AWS's benchmark ran 75,000 concurrent agents on 8 GB of memory, and on Lambda/SQS agents cost nothing while waiting for tool results.
What you could build with it
A small SaaS team could run thousands of long-lived support agents on a single serverless bill by building on Infinity's suspend-on-tool-call runtime, so agents waiting on APIs or approvals cost nothing until they wake.
Does it hold up?
Too early to judge: the runtime is days old with 22 stars and no independent production reports yet, and its headline 75,000-agent figure comes from AWS's own simulated-workload benchmark rather than real deployments.
Built with Infinity
- AWS Infinity: 75,000 Agents, but No Pi in the Testalfw.ai · Independent read of the benchmark: the 75,000-agent figure comes from a simulated workload on a server thread, measuring ~100 KB of idle-agent memory, not 75,000 simultaneous model inferences.
- AI this week (Oct 19-25): agent standards and distribution weekDEV · Weekly roundup listing AWS's open-sourcing of the Infinity agent runtime among the week's agent-infrastructure moves.
Learn more
First spotted on github: source.
More AI agents
Agent ReachOpen-source CLI and SKILL.md kit that gives AI agents read/search access to 15+ internet platforms (Twitter, Reddit…agents · JEV 0.8AI Job Search — the job hunt that runs on your machineOpen-source Claude Code framework that turns job hunting into an agentic pipeline: scrape portals, score fit, tailor…agents · JEV 0.79PentAGI — fully autonomous AI agents for penetration testingPentAGI is a self-hosted, open-source system where a team of AI agents plans and executes authorized penetration tests…agents · JEV 0.77PPT Master: AI skill that generates native, editable PowerPoint decks from any documentOpen-source AI agent workflow that turns documents or topics into real, native PowerPoint decks: native shapes…agents · JEV 0.76Docker Agent: AI agent builder and runtime by Docker EngineeringA Docker CLI plugin for building, running and sharing AI agents with declarative YAML config, multi-agent…agents · JEV 0.75K-Dense-AI/scientific-agent-skills: turn any AI agent into an AI scientistK-Dense AI's open collection of 177 validated, lazily-loaded skills that turn any agent (Cursor, Claude Code, Codex…agents · JEV 0.74
Get the week's best AI launches, plus 3 ideas worth building
One email every Saturday. Ranked by traction, not hype. Free.