Skip to content

Commit 6735f46

Browse files
authored
fix: Update to use latest benchmarking script (#3076)
1 parent 8bc871e commit 6735f46

File tree

2 files changed

+3
-3
lines changed
  • components/backends/trtllm/performance_sweeps/scripts

2 files changed

+3
-3
lines changed

components/backends/trtllm/performance_sweeps/scripts/bench.sh

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -156,7 +156,7 @@ python3 ${SCRIPTS_DIR}/scripts/bench/benchmark_serving.py \
156156
--random-range-ratio 0.8 \
157157
--ignore-eos \
158158
--use-chat-template \
159-
--backend "openai" \
159+
--backend "dynamo" \
160160
--endpoint "/v1/completions" \
161161
--percentile-metrics ttft,tpot,itl,e2el \
162162
--max-concurrency "1" \
@@ -181,7 +181,7 @@ for concurrency in ${concurrency_list}; do
181181
--use-chat-template \
182182
--ignore-eos \
183183
--use-chat-template \
184-
--backend "openai" \
184+
--backend "dynamo" \
185185
--endpoint "/v1/completions" \
186186
--percentile-metrics ttft,tpot,itl,e2el \
187187
--max-concurrency "$concurrency" \

0 commit comments

Comments
 (0)