Skip to content

chore: 🔨 Use the v0.3.0 llm-d-inference-sim image tag. #1140

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 4 commits into from
Jul 23, 2025
Merged

chore: 🔨 Use the v0.3.0 llm-d-inference-sim image tag. #1140

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
a04416b
chore: 🔨 Use the latest llm-d-inference-sim image tag.
yafengio Jul 11, 2025
ebea94f
feat: 🔨 Compatible with llm-d-inference-sim v0.3.0.
yafengio Jul 23, 2025
2823434
chore: ⬆️ bump llm-d-inference-sim to v0.3.0 (default).
yafengio Jul 23, 2025
cc14228
chore: ⬆️ replace with v0.3.0 tag.
yafengio Jul 23, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .github/ISSUE_TEMPLATE/new-release.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -42,7 +42,7 @@ This document defines the process for releasing Gateway API Inference Extension.
```shell
export VLLM_GPU=0.9.2
export VLLM_CPU=0.9.3
export VLLM_SIM=0.1.2
export VLLM_SIM=0.3.0
```

## Release Process
Expand Down
6 changes: 3 additions & 3 deletions config/manifests/vllm/sim-deployment.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -14,7 +14,7 @@ spec:
spec:
containers:
- name: vllm-sim
image: ghcr.io/llm-d/llm-d-inference-sim:v0.1.2
image: ghcr.io/llm-d/llm-d-inference-sim:v0.3.0
imagePullPolicy: Always
args:
- --model
Expand All @@ -23,8 +23,8 @@ spec:
- "8000"
- --max-loras
- "2"
- --lora
- food-review-1
- --lora-modules
- '{"name": "food-review-1"}'
env:
- name: POD_NAME
valueFrom:
Expand Down
2 changes: 1 addition & 1 deletion hack/release-quickstart.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -35,7 +35,7 @@ VLLM_GPU="${VLLM_GPU:-0.9.1}"
# The CPU image is from https://gallery.ecr.aws/q9t5s3a7/vllm-cpu-release-repo
VLLM_CPU="${VLLM_CPU:-0.9.1}"
# The sim image is from https://github.com/llm-d/llm-d-inference-sim/pkgs/container/llm-d-inference-sim
VLLM_SIM="${VLLM_SIM:-0.1.1}"
VLLM_SIM="${VLLM_SIM:-0.3.0}"

echo "Using release tag: ${RELEASE_TAG}"
echo "Using vLLM GPU image version: ${VLLM_GPU}"
Expand Down