VibeCoder Journal - Independent LLM Benchmark Index Tracking 22 Frontier Models
Independently run coding benchmark index (SWE-bench Verified, Terminal-Bench, Aider Polyglot, LiveCodeBench) ranking frontier models with measured speed and price data.
Why it matters
Every figure is verified against primary source logs without prompt leakage, and it publishes intelligence-vs-cost pareto data that most leaderboards omit.
What you could build with it
A startup building an LLM router could use this index's intelligence-vs-cost matrix as a public data source for its model-selection defaults, giving customers a transparent, third-party basis for why traffic shifts between models.
Does it hold up?
Usable today: the rankings page is live and updated daily with empirical telemetry; the methodology claims independent harness runs, but third-party validation of the numbers is pending.
Built with VibeCoder Journal
- Show HN: Independent LLM benchmark index tracking 22 frontier modelshn · Launch discussion on Hacker News (posted 2026-10-18).
Learn more
First spotted on article: source.
More AI models
OpenAI publishes 722 AI-generated math manuscripts from an unreleased modelOpenAI released 722 mathematical manuscripts in 372 result families to GitHub under Apache-2.0, produced by an…models · JEV 0.74Tencent Hunyuan Hy3: open 295B MoE with 21B active under Apache 2.0Tencent open-sourced Hy3, a 295B-parameter mixture-of-experts model with only 21B parameters active per token, under…models · JEV 0.73NVIDIA Isaac Lab 3.0 GA + Isaac OS open runtime + Agile ONE SN humanoidMajor Isaac platform expansion at GTC Berlin Oct 21: Isaac Lab 3.0 is generally available as the open-source robot…models · JEV 0.73StepFun Step-5-Preview — open BF16 weights releasedStepFun published the full BF16 weights for its flagship Step-5-Preview agentic model (600B-parameter sparse MoE, 27B…models · JEV 0.73NVIDIA Nemotron 3.5 Retriever collection: Embed 8B/1B, Rerank 8B, Parse 631MNVIDIA's Oct 21 collection drop for agentic retrieval: Nemotron-3.5-Embed in 8B BF16, 1B BF16 and 1B NVFP4…models · JEV 0.72Kimi K3.1 Pro: Moonshot's 2.8T open-weight flagship officially launchesMoonshot AI officially launched Kimi K3.1 Pro on Oct 23, a mixture-of-experts model with 2.8 trillion total / 104…models · JEV 0.72
Get the week's best AI launches, plus 3 ideas worth building
One email every Saturday. Ranked by traction, not hype. Free.