[Enhancement Request] Move to Llama 2 #38
Description
Describe the Enhancement
Open AI uses a paid for and complicated API service to access the GPT service. It is very user antagonistic. Migration to Llama as the backend LLM service is more inline with the OS goal and easier on the user experience as it free and can be included with the service.
Describe the current behavior
Currently, uses the closed sourced and paid OpenAI API
Describe alternatives to your enhancement
I believe GPT4All could achieve similar results
Potential Issues and Fixes
Issue: Any open source LLM will need to be run locally. This still requires some work on the user end for initial setup.
Fixes: Automate install of LLM?
Also look into deployment on Hugging Face to circumvent local install entirely