Hugging Face's logo

DonatoDiffusion
/
Wan2.1-Fun-1.3B-Control

Text-to-Video
Diffusers
Safetensors
English
Chinese
i2v
video
video-generation
Model card Files
xet
Community
bubbliiiing commited on
Commit
71dd05c
·
1 Parent(s): 4ff356d

Update Readme

Browse files
Files changed (2) hide show
  1. README.md +43 -3
  2. README_en.md +44 -3
README.md CHANGED
@@ -33,10 +33,12 @@ V1.0:
33
  |--|--|--|--|--|
34
  | Wan2.1-Fun-1.3B-InP | 19.0 GB | [🤗Link](https://huggingface.co/alibaba-pai/Wan2.1-Fun-1.3B-InP) | [😄Link](https://modelscope.cn/models/PAI/Wan2.1-Fun-1.3B-InP) | Wan2.1-Fun-1.3B文图生视频权重，以多分辨率训练，支持首尾图预测。 |
35
  | Wan2.1-Fun-14B-InP | 47.0 GB | [🤗Link](https://huggingface.co/alibaba-pai/Wan2.1-Fun-14B-InP) | [😄Link](https://modelscope.cn/models/PAI/Wan2.1-Fun-14B-InP) | Wan2.1-Fun-14B文图生视频权重，以多分辨率训练，支持首尾图预测。 |
 
 
36
 
37
  # 视频作品
38
 
39
- ### Wan2.1-Fun-14B-InP
40
 
41
  <table border="0" style="width: 100%; text-align: left; margin-top: 20px;">
42
  <tr>
@@ -55,8 +57,6 @@ V1.0:
55
  </tr>
56
  </table>
57
 
58
- ### Wan2.1-Fun-1.3B-InP
59
-
60
  <table border="0" style="width: 100%; text-align: left; margin-top: 20px;">
61
  <tr>
62
  <td>
@@ -74,6 +74,46 @@ V1.0:
74
  </tr>
75
  </table>
76
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
77
  # 快速启动
78
  ### 1. 云使用: AliyunDSW/Docker
79
  #### a. 通过阿里云 DSW
 
33
  |--|--|--|--|--|
34
  | Wan2.1-Fun-1.3B-InP | 19.0 GB | [🤗Link](https://huggingface.co/alibaba-pai/Wan2.1-Fun-1.3B-InP) | [😄Link](https://modelscope.cn/models/PAI/Wan2.1-Fun-1.3B-InP) | Wan2.1-Fun-1.3B文图生视频权重，以多分辨率训练，支持首尾图预测。 |
35
  | Wan2.1-Fun-14B-InP | 47.0 GB | [🤗Link](https://huggingface.co/alibaba-pai/Wan2.1-Fun-14B-InP) | [😄Link](https://modelscope.cn/models/PAI/Wan2.1-Fun-14B-InP) | Wan2.1-Fun-14B文图生视频权重，以多分辨率训练，支持首尾图预测。 |
36
+ | Wan2.1-Fun-1.3B-Control | 19.0 GB | [🤗Link](https://huggingface.co/alibaba-pai/Wan2.1-Fun-1.3B-Control) | [😄Link](https://modelscope.cn/models/PAI/Wan2.1-Fun-1.3B-Control)| Wan2.1-Fun-1.3B视频控制权重，支持不同的控制条件，如Canny、Depth、Pose、MLSD等，同时支持使用轨迹控制。支持多分辨率（512，768，1024）的视频预测，支持多分辨率（512，768，1024）的视频预测，以81帧、每秒16帧进行训练，支持多语言预测 |
37
+ | Wan2.1-Fun-14B-Control | 47.0 GB | [🤗Link](https://huggingface.co/alibaba-pai/Wan2.1-Fun-14B-Control) | [😄Link](https://modelscope.cn/models/PAI/Wan2.1-Fun-14B-Control)| Wan2.1-Fun-14B视频控制权重，支持不同的控制条件，如Canny、Depth、Pose、MLSD等，同时支持使用轨迹控制。支持多分辨率（512，768，1024）的视频预测，支持多分辨率（512，768，1024）的视频预测，以81帧、每秒16帧进行训练，支持多语言预测 |
38
 
39
  # 视频作品
40
 
41
+ ### Wan2.1-Fun-14B-InP && Wan2.1-Fun-1.3B-InP
42
 
43
  <table border="0" style="width: 100%; text-align: left; margin-top: 20px;">
44
  <tr>
 
57
  </tr>
58
  </table>
59
 
 
 
60
  <table border="0" style="width: 100%; text-align: left; margin-top: 20px;">
61
  <tr>
62
  <td>
 
74
  </tr>
75
  </table>
76
 
77
+ ### Wan2.1-Fun-14B-Control && Wan2.1-Fun-1.3B-Control
78
+
79
+ <table border="0" style="width: 100%; text-align: left; margin-top: 20px;">
80
+ <tr>
81
+ <td>
82
+ <video src="https://github.com/user-attachments/assets/f35602c4-9f0a-4105-9762-1e3a88abbac6" width="100%" controls autoplay loop></video>
83
+ </td>
84
+ <td>
85
+ <video src="https://github.com/user-attachments/assets/8b0f0e87-f1be-4915-bb35-2d53c852333e" width="100%" controls autoplay loop></video>
86
+ </td>
87
+ <td>
88
+ <video src="https://github.com/user-attachments/assets/972012c1-772b-427a-bce6-ba8b39edcfad" width="100%" controls autoplay loop></video>
89
+ </td>
90
+ <tr>
91
+ </table>
92
+
93
+ <table border="0" style="width: 100%; text-align: left; margin-top: 20px;">
94
+ <tr>
95
+ <td>
96
+ <video src="https://github.com/user-attachments/assets/53002ce2-dd18-4d4f-8135-b6f68364cabd" width="100%" controls autoplay loop></video>
97
+ </td>
98
+ <td>
99
+ <video src="https://github.com/user-attachments/assets/fce43c0b-81fa-4ab2-9ca7-78d786f520e6" width="100%" controls autoplay loop></video>
100
+ </td>
101
+ <td>
102
+ <video src="https://github.com/user-attachments/assets/b208b92c-5add-4ece-a200-3dbbe47b93c3" width="100%" controls autoplay loop></video>
103
+ </td>
104
+ <tr>
105
+ <td>
106
+ <video src="https://github.com/user-attachments/assets/c6c5d557-9772-483e-ae47-863d8a26db4a" width="100%" controls autoplay loop></video>
107
+ </td>
108
+ <td>
109
+ <video src="https://github.com/user-attachments/assets/af617971-597c-4be4-beb5-f9e8aaca2d14" width="100%" controls autoplay loop></video>
110
+ </td>
111
+ <td>
112
+ <video src="https://github.com/user-attachments/assets/8411151e-f491-4264-8368-7fc3c5a6992b" width="100%" controls autoplay loop></video>
113
+ </td>
114
+ </tr>
115
+ </table>
116
+
117
  # 快速启动
118
  ### 1. 云使用: AliyunDSW/Docker
119
  #### a. 通过阿里云 DSW
README_en.md CHANGED
@@ -33,10 +33,13 @@ V1.0:
33
  |--|--|--|--|--|
34
  | Wan2.1-Fun-1.3B-InP | 19.0 GB | [🤗Link](https://huggingface.co/alibaba-pai/Wan2.1-Fun-1.3B-InP) | [😄Link](https://modelscope.cn/models/PAI/Wan2.1-Fun-1.3B-InP) | Wan2.1-Fun-1.3B text-to-video weights, trained at multiple resolutions, supporting start and end frame prediction. |
35
  | Wan2.1-Fun-14B-InP | 47.0 GB | [🤗Link](https://huggingface.co/alibaba-pai/Wan2.1-Fun-14B-InP) | [😄Link](https://modelscope.cn/models/PAI/Wan2.1-Fun-14B-InP) | Wan2.1-Fun-14B text-to-video weights, trained at multiple resolutions, supporting start and end frame prediction. |
 
 
 
36
 
37
  # Video Result
38
 
39
- ### Wan2.1-Fun-14B-InP
40
 
41
  <table border="0" style="width: 100%; text-align: left; margin-top: 20px;">
42
  <tr>
@@ -55,8 +58,6 @@ V1.0:
55
  </tr>
56
  </table>
57
 
58
- ### Wan2.1-Fun-1.3B-InP
59
-
60
  <table border="0" style="width: 100%; text-align: left; margin-top: 20px;">
61
  <tr>
62
  <td>
@@ -74,6 +75,46 @@ V1.0:
74
  </tr>
75
  </table>
76
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
77
  # Quick Start
78
  ### 1. Cloud usage: AliyunDSW/Docker
79
  #### a. From AliyunDSW
 
33
  |--|--|--|--|--|
34
  | Wan2.1-Fun-1.3B-InP | 19.0 GB | [🤗Link](https://huggingface.co/alibaba-pai/Wan2.1-Fun-1.3B-InP) | [😄Link](https://modelscope.cn/models/PAI/Wan2.1-Fun-1.3B-InP) | Wan2.1-Fun-1.3B text-to-video weights, trained at multiple resolutions, supporting start and end frame prediction. |
35
  | Wan2.1-Fun-14B-InP | 47.0 GB | [🤗Link](https://huggingface.co/alibaba-pai/Wan2.1-Fun-14B-InP) | [😄Link](https://modelscope.cn/models/PAI/Wan2.1-Fun-14B-InP) | Wan2.1-Fun-14B text-to-video weights, trained at multiple resolutions, supporting start and end frame prediction. |
36
+ | Wan2.1-Fun-1.3B-Control | 19.0 GB | [🤗Link](https://huggingface.co/alibaba-pai/Wan2.1-Fun-1.3B-Control) | [😄Link](https://modelscope.cn/models/PAI/Wan2.1-Fun-1.3B-Control) | Wan2.1-Fun-1.3B video control weights, supporting various control conditions such as Canny, Depth, Pose, MLSD, etc., and trajectory control. Supports multi-resolution (512, 768, 1024) video prediction at 81 frames, trained at 16 frames per second, with multilingual prediction support. |
37
+ | Wan2.1-Fun-14B-Control | 47.0 GB | [🤗Link](https://huggingface.co/alibaba-pai/Wan2.1-Fun-14B-Control) | [😄Link](https://modelscope.cn/models/PAI/Wan2.1-Fun-14B-Control) | Wan2.1-Fun-14B video control weights, supporting various control conditions such as Canny, Depth, Pose, MLSD, etc., and trajectory control. Supports multi-resolution (512, 768, 1024) video prediction at 81 frames, trained at 16 frames per second, with multilingual prediction support. |
38
+
39
 
40
  # Video Result
41
 
42
+ ### Wan2.1-Fun-14B-InP && Wan2.1-Fun-1.3B-InP
43
 
44
  <table border="0" style="width: 100%; text-align: left; margin-top: 20px;">
45
  <tr>
 
58
  </tr>
59
  </table>
60
 
 
 
61
  <table border="0" style="width: 100%; text-align: left; margin-top: 20px;">
62
  <tr>
63
  <td>
 
75
  </tr>
76
  </table>
77
 
78
+ ### Wan2.1-Fun-14B-Control && Wan2.1-Fun-1.3B-Control
79
+
80
+ <table border="0" style="width: 100%; text-align: left; margin-top: 20px;">
81
+ <tr>
82
+ <td>
83
+ <video src="https://github.com/user-attachments/assets/f35602c4-9f0a-4105-9762-1e3a88abbac6" width="100%" controls autoplay loop></video>
84
+ </td>
85
+ <td>
86
+ <video src="https://github.com/user-attachments/assets/8b0f0e87-f1be-4915-bb35-2d53c852333e" width="100%" controls autoplay loop></video>
87
+ </td>
88
+ <td>
89
+ <video src="https://github.com/user-attachments/assets/972012c1-772b-427a-bce6-ba8b39edcfad" width="100%" controls autoplay loop></video>
90
+ </td>
91
+ <tr>
92
+ </table>
93
+
94
+ <table border="0" style="width: 100%; text-align: left; margin-top: 20px;">
95
+ <tr>
96
+ <td>
97
+ <video src="https://github.com/user-attachments/assets/53002ce2-dd18-4d4f-8135-b6f68364cabd" width="100%" controls autoplay loop></video>
98
+ </td>
99
+ <td>
100
+ <video src="https://github.com/user-attachments/assets/fce43c0b-81fa-4ab2-9ca7-78d786f520e6" width="100%" controls autoplay loop></video>
101
+ </td>
102
+ <td>
103
+ <video src="https://github.com/user-attachments/assets/b208b92c-5add-4ece-a200-3dbbe47b93c3" width="100%" controls autoplay loop></video>
104
+ </td>
105
+ <tr>
106
+ <td>
107
+ <video src="https://github.com/user-attachments/assets/c6c5d557-9772-483e-ae47-863d8a26db4a" width="100%" controls autoplay loop></video>
108
+ </td>
109
+ <td>
110
+ <video src="https://github.com/user-attachments/assets/af617971-597c-4be4-beb5-f9e8aaca2d14" width="100%" controls autoplay loop></video>
111
+ </td>
112
+ <td>
113
+ <video src="https://github.com/user-attachments/assets/8411151e-f491-4264-8368-7fc3c5a6992b" width="100%" controls autoplay loop></video>
114
+ </td>
115
+ </tr>
116
+ </table>
117
+
118
  # Quick Start
119
  ### 1. Cloud usage: AliyunDSW/Docker
120
  #### a. From AliyunDSW