System Message Tools

[RomneyDa]

A remake of #5809

• Adds support for tools in the form of XML system message instructions and response content parsing + tests
• Tools are parsed as they come in, converted to ToolCalls, and on the way out converted back to text. Switching between native and non-native tools is interchangeable with this approach.
• For now, this applies only to models that are NOT known to support native tools
• Adds a warning to the Agent mode dropdown that shows for any models not known to be great with tools (including models that support native tools)

All models can now be used in Agent mode

[netlify]

✅ Deploy Preview for continuedev canceled.

Name	Link
🔨 Latest commit	76f075e
🔍 Latest deploy log	https://app.netlify.com/projects/continuedev/deploys/686876b289104a0008a90a80

[cubic-dev-ai]

cubic reviewed 6 files and found no issues. Review PR in cubic.dev.

[cubic-dev-ai]

cubic found 2 issues across 7 files. Review them in cubic.dev

_{React with 👍 or 👎 to teach cubic. Tag @cubic-dev-ai to give specific feedback.}

[cubic-dev-ai]

cubic found 5 issues across 38 files. Review them in cubic.dev

_{React with 👍 or 👎 to teach cubic. Tag @cubic-dev-ai to give specific feedback.}

[RomneyDa]

note to update tool descriptions based on https://github.com/continuedev/continue/pull/6421/files

[sestinj]

@RomneyDa Tried first with Sonnet and I'm not sure whether this is a parsing bug, but it seems to mostly not stop when a tool is called, so it ends up just streaming multiple tools in a single assistant output, none of them getting called

[sestinj]

When using o3-mini on the other hand seems like it does actually stop the stream, call the tool, and then call the assistant again.

I'm also seeing a little bit of bugginess around it randomly starting and stopping the stream, but don't have a super clear grasp yet on what causes that.