Skip to content

Commit b38bd4a

Browse files
committed
Enable multiple postprocess workers tests for chat completions api
Signed-off-by: Junyi Xu <[email protected]>
1 parent 040a895 commit b38bd4a

File tree

1 file changed

+10
-2
lines changed

1 file changed

+10
-2
lines changed

tests/unittest/llmapi/apps/_test_openai_chat_harmony.py

Lines changed: 10 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -14,10 +14,18 @@ def model():
1414
return "gpt_oss/gpt-oss-20b/"
1515

1616

17+
@pytest.fixture(scope="module",
18+
params=[0, 2],
19+
ids=["disable_processpool", "enable_processpool"])
20+
def num_postprocess_workers(request):
21+
return request.param
22+
23+
1724
@pytest.fixture(scope="module")
18-
def server(model: str):
25+
def server(model: str, num_postprocess_workers: int):
1926
model_path = get_model_path(model)
20-
with RemoteOpenAIServer(model_path) as remote_server:
27+
args = ["--num_postprocess_workers", f"{num_postprocess_workers}"]
28+
with RemoteOpenAIServer(model_path, args) as remote_server:
2129
yield remote_server
2230

2331

0 commit comments

Comments
 (0)