MCP servers look very cool in a demo with a dozen of tools, but how about when you have hundreds of workflows?
Have you found a reliable strategy to discover or rank the right tools? Any advanced tips for names, descriptions or categorization?
I know Claude now has the Tool Search tool, but can’t find anything similar for OAI or Google models.
Hello - I have read about the Claude tool search but haven’t tried it myself. Curious to hear how well it works from your perspective.
If using copilot in vs code, it switches to virtual tools if you have more than 128 tools selected. According to docs, virtual tools essentially group similar tools together. The original context will only have virtual tools. The model ‘expands’ a specific virtual group to get specific tools based on the prompt.
github.copilot.chat.virtualTools.threshold
(Experimental)
Tool count over which virtual tools should be used. Virtual tools group similar sets of tools together and enable the model to activate them on-demand. Enables you to go beyond the limit of 128 tools for a chat request.
Personally, I have been manually managing the toolset to keep the count low but curious about others suggestions around names, description etc.