Skip to content

Commit 9f41d7a

Browse files
Update docs/source/engines/toolkit.mdx
Co-authored-by: Michelle Habonneau <[email protected]>
1 parent 2a604fb commit 9f41d7a

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

docs/source/engines/toolkit.mdx

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,7 @@
11
# Inference Toolkit
22

33
In some cases, the model you're looking to deploy isn't supported by any of the high-performance inference engines. In this case,
4-
we provide a fallback option that works with most models. The Inference Toolkit supports models that are implemented in the
4+
we provide a fallback option. The Inference Toolkit supports models that are implemented in the
55
Transformers, Sentence-Transformers and Diffusers libraries, and wraps them in a light web server.
66

77
The Inference Toolkit is perfect for testing models and building demos, but isn't as production-ready as TGI, vLLM, SGLang, or llama.cpp.

0 commit comments

Comments
 (0)