StarSkirmish Bench v0.2 — LLMs play StarCraft: Brood War by writing code
Refreshed public benchmark where flagship LLMs (OpenAI, Anthropic, Google, Meta — including Gemini 4 Argon) play StarCraft: Brood War by writing bot code, with a published results leaderboard.
Why it matters
A rare public eval of sustained long-horizon agentic reasoning under real-time strategic pressure — coding + planning + adaptation in one arena.
What you could build with it
An AI lab or game studio could adopt the bench as a standardized eval for coding agents' long-horizon planning, or extend the harness to other RTS and economic simulations to stress-test agents before trusting them with production systems.
Does it hold up?
The bench publishes real model-vs-model results and the HN thread shows substantive discussion; as an eval harness it looks concrete, though independent reproductions are not yet visible.
Built with StarSkirmish Bench v0.2 — LLMs play StarCraft
- Show HN: Gemini 4 Argon plays StarCraftHacker News · 42-comment discussion of the refreshed benchmark and flagship-model results.
- StarSkirmish Bench v0.2 leaderboardofficial site · Live results comparing flagship LLMs head-to-head.
Learn more
First spotted on article: source.
More AI agents
Agent ReachOpen-source CLI and SKILL.md kit that gives AI agents read/search access to 15+ internet platforms (Twitter, Reddit…agents · JEV 0.8AI Job Search — the job hunt that runs on your machineOpen-source Claude Code framework that turns job hunting into an agentic pipeline: scrape portals, score fit, tailor…agents · JEV 0.79PentAGI — fully autonomous AI agents for penetration testingPentAGI is a self-hosted, open-source system where a team of AI agents plans and executes authorized penetration tests…agents · JEV 0.77PPT Master: AI skill that generates native, editable PowerPoint decks from any documentOpen-source AI agent workflow that turns documents or topics into real, native PowerPoint decks: native shapes…agents · JEV 0.76Docker Agent: AI agent builder and runtime by Docker EngineeringA Docker CLI plugin for building, running and sharing AI agents with declarative YAML config, multi-agent…agents · JEV 0.75K-Dense-AI/scientific-agent-skills: turn any AI agent into an AI scientistK-Dense AI's open collection of 177 validated, lazily-loaded skills that turn any agent (Cursor, Claude Code, Codex…agents · JEV 0.74
Get the week's best AI launches, plus 3 ideas worth building
One email every Saturday. Ranked by traction, not hype. Free.