Consider running a conformance test against the MCP spec #1407
Description
One of interesting things about toolhive is that it takes care of the pesky low-level issues like the auth spec. But, we don't know if thv is actually spec-compliant, there might be issues we don't know about despite thv working in the clients we tested.
It would be great to explore one of the existing test beds for spec compliance. I have not tried them myself, but those mentioned on the upstream discord included:
- https://github.com/Janix-ai/mcp-validator
- there is a draft PR upstream at [wip] Client auth compatibility checker modelcontextprotocol/inspector#694
The goal of this issue is to evaluate the existing and upcoming (the closer to upstream the better IMO) approaches to conformance testing and see if we can use them for toolhive testing.