|
--- |
|
license: apache-2.0 |
|
--- |
|
Diffusers formation for mochi-1-preview model. |
|
|
|
It was create by scripts: https://github.com/huggingface/diffusers/blob/main/scripts/convert_mochi_to_diffusers.py |
|
|
|
The model can be directly load from pretrained with mochi branch: https://github.com/huggingface/diffusers/tree/mochi-t2v |
|
|
|
You can directly use the zipped file branch in: https://huggingface.co/feizhengcong/mochi-1-preview-diffusers/blob/main/diffusers-mochi.zip |
|
|
|
|
|
```bash |
|
from diffusers import MochiPipeline |
|
from diffusers.utils import export_to_video |
|
|
|
pipe = MochiPipeline.from_pretrained(model_path, torch_dtype=torch.bfloat16) |
|
pipe.to("cuda") |
|
prompt = "Close-up of a chameleon's eye, with its scaly skin changing color. Ultra high resolution 4k." |
|
frames = pipe(prompt, |
|
num_inference_steps=50, |
|
guidance_scale=4.5, |
|
num_frames=61, |
|
generator=torch.Generator(device="cuda").manual_seed(42), |
|
).frames[0] |
|
|
|
export_to_video(frames, "mochi.mp4") |
|
``` |
|
|
|
Some generated results: |
|
|
|
|
|
<video controls autoplay src="https://cdn-uploads.huggingface.co/production/uploads/62e34a12c9bece303d146af8/Cm3I6kidy2YP5nu3un7XP.mp4"></video> |
|
|
|
<video controls autoplay src="https://cdn-uploads.huggingface.co/production/uploads/62e34a12c9bece303d146af8/bVNem7sGTvBEjxQG7MHw_.mp4"></video> |
|
|
|
<video controls autoplay src="https://cdn-uploads.huggingface.co/production/uploads/62e34a12c9bece303d146af8/0YWv2KJwH_UB2WkWjO_bP.mp4"></video> |
|
|
|
|
|
<video controls autoplay src="https://cdn-uploads.huggingface.co/production/uploads/62e34a12c9bece303d146af8/TOLKdMx-kFLCNXD6nIVHm.mp4"></video> |
|
|
|
|
|
Pretty thanks for the discussion in https://github.com/huggingface/diffusers/pull/9769 |
|
|
|
11.04 updation for vae encoder releasing. |
|
|
|
|
|
--- |
|
license: apache-2.0 |
|
--- |
