Instructions to use FastDM/Wan2.2-T2V-A14B-Merge-Lightning-V1.1-Diffusers with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use FastDM/Wan2.2-T2V-A14B-Merge-Lightning-V1.1-Diffusers with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("FastDM/Wan2.2-T2V-A14B-Merge-Lightning-V1.1-Diffusers", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -7,6 +7,11 @@ pipeline_tag: text-to-video
|
|
| 7 |
---
|
| 8 |
This model is a merger of [Wan-AI/Wan2.2-T2V-A14B-Diffusers](https://huggingface.co/Wan-AI/Wan2.2-T2V-A14B-Diffusers) and [Wan2.2-Lightning v1 model](https://huggingface.co/lightx2v/Wan2.2-Lightning/tree/main/Wan2.2-I2V-A14B-4steps-lora-rank64-Seko-V1), it can be run with diffusers pipeline.
|
| 9 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 10 |
Running with diffusers:
|
| 11 |
```python
|
| 12 |
import torch
|
|
@@ -36,11 +41,4 @@ output = pipe(
|
|
| 36 |
).frames[0]
|
| 37 |
export_to_video(output, "t2v_out.mp4", fps=16)
|
| 38 |
|
| 39 |
-
```
|
| 40 |
-
|
| 41 |
-
**For speedup infer**, you can use [FastDM](https://github.com/KE-AI-ENG/FastDM), which generate a 720x1280 vedio with H20 only cost 120s.
|
| 42 |
-
|
| 43 |
-
test command:
|
| 44 |
-
```
|
| 45 |
-
python gen.py --model-path FastDM/Wan2.2-T2V-A14B-Merge-Lightning-V1.1-Diffusers --architecture wan --guidance-scale 1.0 --height 720 --width 1280 --steps 4 --use-fp8 --output-path ./wan-a14b-lightningv1.1-fp8-guid1.mp4 --num-frames 81 --fps 16 --prompts "Two anthropomorphic cats in comfy boxing gear and bright gloves fight intensely on a spotlighted stage."
|
| 46 |
```
|
|
|
|
| 7 |
---
|
| 8 |
This model is a merger of [Wan-AI/Wan2.2-T2V-A14B-Diffusers](https://huggingface.co/Wan-AI/Wan2.2-T2V-A14B-Diffusers) and [Wan2.2-Lightning v1 model](https://huggingface.co/lightx2v/Wan2.2-Lightning/tree/main/Wan2.2-I2V-A14B-4steps-lora-rank64-Seko-V1), it can be run with diffusers pipeline.
|
| 9 |
|
| 10 |
+
Running with [FastDM](https://github.com/KE-AI-ENG/FastDM):
|
| 11 |
+
```
|
| 12 |
+
python gen.py --model-path FastDM/Wan2.2-T2V-A14B-Merge-Lightning-V1.1-Diffusers --architecture wan --guidance-scale 1.0 --height 720 --width 1280 --steps 4 --use-fp8 --output-path ./wan-a14b-lightningv1.1-fp8-guid1.mp4 --num-frames 81 --fps 16 --prompts "Two anthropomorphic cats in comfy boxing gear and bright gloves fight intensely on a spotlighted stage."
|
| 13 |
+
```
|
| 14 |
+
|
| 15 |
Running with diffusers:
|
| 16 |
```python
|
| 17 |
import torch
|
|
|
|
| 41 |
).frames[0]
|
| 42 |
export_to_video(output, "t2v_out.mp4", fps=16)
|
| 43 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 44 |
```
|