Skip to main content
← Lab

toolfetch

confirmedPython · CPU-localInference & servingJuly 3, 2026

the question

For LLM tool-calling, do you retrieve fewer tools or inject more into the context window?

what came out

The measured retrieve-vs-inject frontier on a CPU-local model: how many tools you can put in context before it stops picking the right one. Real ToolRet labels, exact-match scoring, no LLM judge.

method & receipts

  • Result: confirmed
  • Tested — a correctness/benchmark suite ships alongside the code.

→ read the code and re-run it

github.com/v-code01/toolfetch