Skip to content

Commit 8ba688f

Browse files
committed
allow custom config
Signed-off-by: weimingc <[email protected]>
1 parent d9a3530 commit 8ba688f

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

tensorrt_llm/serve/openai_server.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -67,7 +67,7 @@ def __init__(self,
6767
logger.debug("Failed to load AutoProcessor or AutoConfig for %s", hf_tokenizer_path)
6868
self.processor = None
6969
try:
70-
self.model_config = AutoConfig.from_pretrained(hf_tokenizer_path)
70+
self.model_config = AutoConfig.from_pretrained(hf_tokenizer_path, trust_remote_code=trust_remote_code)
7171
except Exception:
7272
logger.debug("Failed to load AutoConfig for %s", hf_tokenizer_path)
7373
self.model_config = None

0 commit comments

Comments
 (0)