LlamaEdge-RAG 0.8.0
Major changes:
-
Support Meta-Llama-3.1-Instruct and internlm2.5-7b-chat tool use
- New prompt template:
llama-3-tool
andinternlm-2-tool
- New prompt template:
-
Add
--main-gpu
and--tensor-split
CLI options -
Update to
llama-core v0.14.0
,chat-prompts v0.11.0
, andendpoints v0.11.1
.