Skip to content

issue with the LLM service -- docker compose service #34

@Raveendiran-RR

Description

@Raveendiran-RR

Issue :
Unable to start the service -LLM if there is any other model apart from llama3.2B

Steps taken :

  1. Updated the ai/smollm2 instead of llama3.2 8B model mentioned in the compose.yaml
  2. run the command : docker compose up -d --build - Got the error that the LLM service could not start
  3. run the command : docker compose down -v to delete the existing containers
  4. Changed the LLM name to ai/smollm2 in the backend.env file too and run docker compose up -d --build. Same error as in Add Testcontainers-based Integration Testing #2
  5. Remove the llm section in the docker compose.yaml file.Run command : docker compose up -d --build
  6. After Implement Testcontainers for development and testing #5, I was able to access the gene-ai app to interact with the ai/smollm2

Please provide the steps such that we can use any or multiple models in this app

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions