0.10.0 - Phi2

[martindevans]

Major Changes

• Update binaries feb 2024 by @martindevans in Update binaries feb 2024 #479
• Add CLBLAST native library to native libraries build by @jasoncouture in Add CLBLAST native library to native libraries build #468
• Introduced a new BatchedExecutor by @martindevans in Introduced a new BatchedExecutor #503
• Swapped StatelessExecutor to use llama_decode! by @martindevans in Swapped StatelessExecutor to use llama_decode! #445
• LLamaToken Struct by @martindevans in LLamaToken Struct #404

Bug Fixes

• KernelMemory EmbeddingMode bug correction by @zsogitbe in KernelMemory EmbeddingMode bug correction #485
• Normalize Embeddings by @martindevans in Normalize Embeddings #507
• StreamingTextDecoder Fix & Tests by @martindevans in StreamingTextDecoder Fix & Tests #428
• Tokenizer Fixes For Issue 430 by @martindevans in Tokenizer Fixes For Issue 430 #433

Other Changes

• Use llama instead of libllama in [DllImport] by @jasoncouture in Use llama instead of libllama in [DllImport] #465
• Updated Examples by @vikramvee in Updated Examples #502
• Added new file types to quantisation by @martindevans in Added new file types to quantisation #495
• Smaller Unit Test Model by @martindevans in Smaller Unit Test Model #496
• Using AddRange in LLamaEmbedder by @martindevans in Using AddRange in LLamaEmbedder #499
• Small KV Cache Handling Improvements by @martindevans in Small KV Cache Handling Improvements #500
• Added increment and decrement operators to LLamaPos by @martindevans in Added increment and decrement operators to LLamaPos #501
• Swapped GetEmbeddings to llama_decode by @martindevans in Swapped GetEmbeddings to llama_decode #474
• kv_cache_instance_methods by @martindevans in kv_cache_instance_methods #454
• Removed IModelParams and IContextParams setters. by @martindevans in Removed IModelParams and IContextParams setters. #472
• Managed LLamaBatch by @martindevans in Managed LLamaBatch #442
• Check Model Path Exists by @martindevans in Check Model Path Exists #437
• Model Metadata Loading Cleanup by @martindevans in Model Metadata Loading Cleanup #438
• Added a check for EOS token in LLamaStatelessExecutor by @martindevans in Added a check for EOS token in LLamaStatelessExecutor #434
• Update README.md by @Oceania2018 in Update README.md #427
• Gpu layer count change by @Kaotic3 in Gpu layer count change #424
• Improved exceptions in IModelParams for unknown KV override types. by @martindevans in Improved exceptions in IModelParams for unknown KV override types. #416

New Contributors

• @Kaotic3 made their first contribution in Gpu layer count change #424
• @Oceania2018 made their first contribution in Update README.md #427
• @jasoncouture made their first contribution in Use llama instead of libllama in [DllImport] #465
• @zsogitbe made their first contribution in KernelMemory EmbeddingMode bug correction #485
• @vikramvee made their first contribution in Updated Examples #502

Full Changelog: 0.9.1...v0.10.0

---

This discussion was created from the release 0.10.0 - Phi2.