---
title: UniAnimate
canonical_url: "https://www.modelscope.cn/models/iic/UniAnimate"
md_url: "https://www.modelscope.cn/models/iic/UniAnimate.md"
repository: iic/UniAnimate
chinese_name: "UniAnimate人像动画"
last_updated: 2024-06-13
pipeline_tag: text-to-video-synthesis
tasks:
  - text-to-video-synthesis
library_name:
  - onnx
  - pytorch
frameworks:
  - Pytorch
downloads: 533462
stars: 26
---

# UniAnimate

> UniAnimate - iic 在 ModelScope 开源的模型。UniAnimate: Taming Unified Video Diffusion Models for Consistent Human Image Animation

- **Repository**: iic/UniAnimate
- **Tasks**: text-to-video-synthesis
- **Downloads**: 533462
- **Stars**: 26
- **Last updated**: 2024-06-13

Source: https://www.modelscope.cn/models/iic/UniAnimate

---

# UniAnimate: Taming Unified Video Diffusion Models for Consistent Human Image Animation

## This repo include the checkpoints for UniAnimate:

- "models/dw-ll_ucoco_384.onnx": the checkpoint for dwpose extraction.

- "models/open_clip_pytorch_model.bin": the checkpoint for clip embedding.

- "models/unianimate_16f_32f_non_ema_223000.pth": the checkpoint for human image animation in UniAnimate (16/32 frames).

- "models/yolox_l.onnx": the checkpoint for dwpose extraction.

- "models/v2-1_512-ema-pruned.ckpt": the checkpoint for Stable Diffusion.




## BibTeX

If this repo is useful to you, please cite our corresponding technical paper.

```bibtex
@article{wang2024unianimate,
      title={UniAnimate: Taming Unified Video Diffusion Models for Consistent Human Image Animation},
      author={Wang, Xiang and Zhang, Shiwei and Gao, Changxin and Wang, Jiayu and Zhou, Xiaoqiang and Zhang, Yingya and Yan, Luxin and Sang, Nong},
      journal={arXiv preprint arXiv:2406.01188},
      year={2024}
}
@inproceedings{TFT2V,
      title={A Recipe for Scaling up Text-to-Video Generation with Text-free Videos},
      author={Wang, Xiang and Zhang, Shiwei and Yuan, Hangjie and Qing, Zhiwu and Gong, Biao and Zhang, Yingya and Shen, Yujun and Gao, Changxin and Sang, Nong},
      booktitle={CVPR},
      year={2024}
}
@article{VideoComposer,
      title={VideoComposer: Compositional Video Synthesis with Motion Controllability},
      author={Wang, Xiang and Yuan, Hangjie and Zhang, Shiwei and Chen, Dayou and Wang, Jiuniu and Zhang, Yingya and Shen, Yujun and Zhao, Deli and Zhou, Jingren},
      journal={NeurIPS},
      year={2023}
}
```