Gemini API Tool Retrieval: load tool schemas on demand
Gemini's Interactions API can now defer tool parameter schemas until an agent actually needs a tool, instead of stuffing the whole tool library into every prompt.
Why it matters
Lets Gemini agents scale to hundreds of tools without blowing up context; the same defer_loading design Anthropic and OpenAI shipped a year earlier.
What you could build with it
A startup building a multi-tool agent could keep hundreds of integrations on standby and load each tool's schema only when a task needs it, so long agent sessions stay inside context limits without dropping tools.
Does it hold up?
Too early to judge — it is a preview with no measured savings, latency or tool-selection accuracy figures from Google yet; the mechanism mirrors Anthropic's and OpenAI's year-old equivalents.
Built with Gemini API Tool Retrieval
- Google Previews On-Demand Tool Retrieval for Gemini API Agentsunite.ai · Announcement coverage: preview in the Interactions API, schemas load only when a task needs them.
- Gemini Can Defer Tool Schemas. It Still Reads the Tool Names.medium · Flags the enterprise caveat that deferred tools still expose names and descriptions to the model.
- Google's Gemini API Drops Schema Overhead for Agents With Hundreds of Toolsalphasignal · Covers server-side, client-side and deferred MCP loading modes and the no-extra-fee billing.
Learn more
First spotted on article: source.
More AI agents
CLI-Anything: make any app agent-native with a generated CLIFrom HKU's Data Intelligence Lab: a seven-phase pipeline that generates a real CLI harness for any GUI application…agents · JEV 0.78DeepSeek Harness: 1.54M daily users and 35,000 plugins into its everything-is-a-plugin runtimeDeepSeek's open-source agent harness where models, tools, sandboxes, sessions and even the UI are all plugins — now…agents · JEV 0.76Dify 1.20.0: OpenTelemetry trace export and malware scanning for LLM appsThe open-source LLM app platform's 1.20.0 release adds trace export to any OpenTelemetry collector, keeps Langfuse…agents · JEV 0.76AG-UI: the open protocol connecting AI agents to user interfacesEvent-based protocol that streams agent activity — text, tool calls, state — to any frontend over 16 standard event…agents · JEV 0.74PaperOrchestra: five agents that turn lab notes into a submission-ready paperGoogle Research's multi-agent framework turns an idea file and an experiment log into a full LaTeX manuscript…agents · JEV 0.74Superpowers: the skills framework that makes coding agents work like careful developersA free Claude Code plugin of 15 skills that forces a disciplined workflow — brainstorm, plan, test-first, review…agents · JEV 0.73
Get the week's best AI launches, plus 3 ideas worth building
One email every Saturday. Ranked by traction, not hype. Free.