BDC Chatbot (WIP)

Chatbot for Biodata Catalyst

Get documentation

Clone the BDC website repo to a directory with the same parent directory as this repo.

Clone the BDC gitbook repo to a directory with the same parent directory as this repo.

Copy environment variables

Copy .env_example to .env and make any necessary changes

Install dependencies

pip install -r requirements.txt
# OR
pip install langchain_chroma langchain_core langchain_openai langchain-community langchain langchain-ollama langserve[all] langchain-cli flashrank chroma-hnswlib langchain-google-genai rank_bm25 nemoguardrails streamlit streamlit_d3graph fastapi[standard] scikit-learn nltk beautifulsoup4 Babel python-dotenv

Port forwarding for local development using vLLM and Ollama at RENCI

kubectl -n ner port-forward svc/vllm-server 8080:80  # vLLM port-forward

kubectl -n ner port-forward svc/ollama 11434:11434                  # Ollama port-forward

Edit .env to match

Create RAG database

python -m utils.preproc_doc                 # preprocess BDC website repo
python -m utils.prepare_chromadb                    # create chroma db

Run chatbot

Standalone Streamlit App

streamlit run app.py                                # run streamlit app

Streamlit Frontend and LangServe/FastAPI Backend

fastapi dev server.py                               # run langserve backend
streamlit run client.py                             # run streamlit frontend

Response Schema

{
    "input": user query,
    "chat_history": chat history,
    "context": retrieved docs,
    "topic": query topic (for predefined response),
    "response": predefined response,
    "flag": predefined response flag,
    "answer": chatbot answer,
    "display_answer": chatbot answer with predefined response,
    "bdcbot_response": bdcbot answer (empty if not called),
    "dugbot_response": dugbot answer (empty if not called)
}

Warning

• If you see ValueError: Received disallowed comparator nin when running the chatbot app, add Comparator.IN, Comparator.NIN to langchain_community\query_constructors\chroma.py under allowed_comparators

Important

• To use ${\color{orange}\text{vLLM}}$ API for chat completion, remove parallel_tool_calls=False from langchain_openai\chat_models\base.py
• Chroma DB initialization might quit without error or warning, might be caused by compatibility issue with Windows.