HumanMCP: A Human-Like Query Dataset for Evaluating MCP Tool Retrieval Performance
arXiv:2602.23367v1 Announce Type: new Abstract: Model Context Protocol MCP servers contain a collection of thousands of opensource standardized tools, linking LLMs to external systems; however, existing datasets and benchmarks lack realistic, humanlike user queries, remaining a critical gap in...
arXiv:2602.23367v1 Announce Type: new Abstract: Model Context Protocol MCP servers contain a collection of thousands of opensource standardized tools, linking LLMs to external systems; however, existing datasets and benchmarks lack realistic, humanlike user queries, remaining a critical gap in evaluating the tool usage and ecosystems of MCP servers.
This content is a summary of the original article from ArXiv AI. Please visit the original site for the full article.
Read Original Article →