File tree Expand file tree Collapse file tree 1 file changed +2
-2
lines changed
docs/source/en/main_classes Expand file tree Collapse file tree 1 file changed +2
-2
lines changed Original file line number Diff line number Diff line change @@ -49,7 +49,7 @@ Inference:
49
49
50
50
1. DeepSpeed ZeRO Inference supports ZeRO stage 3 with ZeRO-Infinity. It uses the same ZeRO protocol as training, but
51
51
it doesn't use an optimizer and a lr scheduler and only stage 3 is relevant. For more details see:
52
- [deepspeed- zero-inference](#deepspeed- zero-inference).
52
+ [zero-inference](#zero-inference).
53
53
54
54
There is also DeepSpeed Inference - this is a totally different technology which uses Tensor Parallelism instead of
55
55
ZeRO (coming soon).
@@ -81,7 +81,7 @@ pip install transformers[deepspeed]
81
81
or find more details on [ the DeepSpeed's GitHub page] ( https://github.com/microsoft/deepspeed#installation ) and
82
82
[ advanced install] ( https://www.deepspeed.ai/tutorials/advanced-install/ ) .
83
83
84
- If you're still struggling with the build, first make sure to read [ zero-install-notes ] ( #zero-install -notes) .
84
+ If you're still struggling with the build, first make sure to read [ CUDA Extension Installation Notes ] ( trainer#cuda-extension-installation -notes) .
85
85
86
86
If you don't prebuild the extensions and rely on them to be built at run time and you tried all of the above solutions
87
87
to no avail, the next thing to try is to pre-build the modules before installing them.
You can’t perform that action at this time.
0 commit comments