-
Notifications
You must be signed in to change notification settings - Fork 6.3k
[docs] Diffusion pipeline #12148
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[docs] Diffusion pipeline #12148
Conversation
src/diffusers/__init__.py
Outdated
@@ -36,6 +36,15 @@ | |||
"configuration_utils": ["ConfigMixin"], | |||
"guiders": [], | |||
"hooks": [], | |||
"image_processor": [ |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Is it ok to add image_processor
and video_processor
to __init__.py
? Otherwise, my local preview of the docs won't build. No big deal either way though :)
The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update. |
from diffusers import DiffusionPipeline | ||
|
||
pipeline = DiffusionPipeline.from_pretrained( | ||
"black-forest-labs/FLUX.1-dev", |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Do we wanna mix Qwen and Flux?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Good point, I'll switch to Qwen and reduce the overall number of different models we use as examples to avoid confusion!
|
||
```py | ||
from diffusers import AnimateDiffPipeline, MotionAdapter, DDIMScheduler |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Are we deleting these?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Yeah I don't think we need to also show animating the image when we already have an example of using from_pipe
for PAG. It seems redundant and adds bloat
src/diffusers/__init__.py
Outdated
_import_structure["image_processor"] = [ | ||
"IPAdapterMaskProcessor", | ||
"PixArtImageProcessor", | ||
"VaeImageProcessor", | ||
"VaeImageProcessorLDM3D", | ||
] | ||
_import_structure["video_processor"] = [ | ||
"VideoProcessor", | ||
] |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
These changes seem unrelated?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
It's unrelated, but if it doesn't hurt then it might be more convenient to include it so we can preview the docs locally. Let me know what you think! :)
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Let's separate them out in this PR and open another one?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Changes are a go barring the ones in dummy_pt_objects.py
(let's tackle it in a separate PR). Thank you!
ec85c73
to
422d85f
Compare
Refreshes the Load pipelines doc with more focus on the
DiffusionPipeline
class and loading it.Main changes:
➕ new device placement section (focusing review on this section would be great!)
➖
## Checkpoint variants
section will be discussed in the Model files and layout doc➖
## DiffusionPipeline explained
section will be moved to the Resources section