Supporting Agent-Mode for models not having tool-call capabilities

[vikash-dev-1]

Validations

• I believe this is a way to improve. I'll try to join the Continue Discord for questions
• I'm not able to find an open issue that requests the same enhancement

Problem

Use-case:
I am using a local custom model that does not support tool calls.
I want to integrate it with Continue and run it in Agent Mode.
Integration with Cline was straightforward, as it already supports XML-based tool call parsing.

However, I’m facing difficulties setting up and using my model with Continue.

Questions

I came across PR #6395, which seems highly relevant to my use case.

Could you please help me with the following questions:

• Is there a timeline for when PR feat: System Message Tools #6395 will be merged?

• Is it possible to work around this issue by:

  • Modifying the configuration,
  • Enforcing tool usage through the system prompt, and
  • Implementing a custom parser?
    If so, are there any example implementations I can refer to?

Thank you in advance for your help!

[Patrick-Erichsen]

Thanks for the bump here, @RomneyDa has been grinding on this for some time and it should be landing soon! Within a week or two at most.

[vikash-dev-1]

That's great! Thanks a lot guys @RomneyDa @Patrick-Erichsen