-
Notifications
You must be signed in to change notification settings - Fork 24
Closed
Description
Issue :
Unable to start the service -LLM if there is any other model apart from llama3.2B
Steps taken :
- Updated the ai/smollm2 instead of llama3.2 8B model mentioned in the compose.yaml
- run the command : docker compose up -d --build - Got the error that the LLM service could not start
- run the command : docker compose down -v to delete the existing containers
- Changed the LLM name to ai/smollm2 in the backend.env file too and run docker compose up -d --build. Same error as in Add Testcontainers-based Integration Testing #2
- Remove the llm section in the docker compose.yaml file.Run command : docker compose up -d --build
- After Implement Testcontainers for development and testing #5, I was able to access the gene-ai app to interact with the ai/smollm2
Please provide the steps such that we can use any or multiple models in this app
Metadata
Metadata
Assignees
Labels
No labels