Skip to content

Inference pool helm chart support ENV from podspec schema #1117

@Gregory-Pereira

Description

@Gregory-Pereira

In our EPP image, we include an ENV value from the secret containing a huggingfacetoken so that we can utilize tokenizers for the various models. Supporting the ENV as it exists in podspec rather than a simple key-value map would allow us to use this secret without exposing it as part of the deployment manifest: https://github.com/kubernetes-sigs/gateway-api-inference-extension/blob/main/config/charts/inferencepool/templates/epp-deployment.yaml#L66-L69.

cc @ahg-g

Metadata

Metadata

Assignees

No one assigned

    Labels

    triage/acceptedIndicates an issue or PR is ready to be actively worked on.

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions