Skip to content

Commit 9e1e5d5

Browse files
xieyangxufacebook-github-bot
authored andcommitted
enable multi-node in external launcher mode
Differential Revision: D88115795
1 parent c0dfc89 commit 9e1e5d5

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

vllm/config/parallel.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -593,10 +593,10 @@ def __post_init__(self) -> None:
593593
"max_parallel_loading_workers is currently "
594594
"not supported and will be ignored."
595595
)
596-
if self.distributed_executor_backend not in ("mp", "uni") and self.nnodes > 1:
596+
if self.distributed_executor_backend not in ("mp", "uni", "external_launcher") and self.nnodes > 1:
597597
raise ValueError(
598598
"nnodes > 1 can only be set when distributed executor "
599-
"backend is mp or uni."
599+
"backend is mp, uni or external_launcher."
600600
)
601601

602602
@property

0 commit comments

Comments
 (0)