Skip to content

LlamaEdge-RAG 0.8.0

Compare
Choose a tag to compare
@github-actions github-actions released this 04 Aug 05:00
· 197 commits to main since this release

Major changes:

  • Support Meta-Llama-3.1-Instruct and internlm2.5-7b-chat tool use

    • New prompt template: llama-3-tool and internlm-2-tool
  • Add --main-gpu and --tensor-split CLI options

  • Update to llama-core v0.14.0, chat-prompts v0.11.0, and endpoints v0.11.1.