---
title: MultiWorldData
canonical_url: "https://www.modelscope.cn/datasets/HaoyuWuRUC/MultiWorldData"
md_url: "https://www.modelscope.cn/datasets/HaoyuWuRUC/MultiWorldData.md"
repository: HaoyuWuRUC/MultiWorldData
chinese_name: "MultiWorld数据-压缩版"
last_updated: 2026-04-21
license: "Apache License 2.0"
storage_size: "81 GB"
downloads: 905
stars: 0
---

# MultiWorldData

> MultiWorldData - HaoyuWuRUC 在 ModelScope 开源的数据集。MultiWorld数据-压缩包 Paper: MultiWorld: Scalable Multi-Agent Multi-View Video World Models

HaoyuWuRUC/MultiWorldData 是 ModelScope 魔搭社区上的数据集，存储大小 81 GB，采用 Apache License 2.0 许可。

- **Repository**: HaoyuWuRUC/MultiWorldData
- **License**: Apache License 2.0
- **Storage size**: 81 GB
- **Downloads**: 905
- **Stars**: 0
- **Last updated**: 2026-04-21

Source: https://www.modelscope.cn/datasets/HaoyuWuRUC/MultiWorldData

---

数据集文件元信息以及数据文件，请浏览“数据集文件”页面获取。

当前数据集卡片使用的是默认模版，数据集的贡献者未提供更加详细的数据集介绍，但是您可以通过如下GIT Clone命令，或者ModelScope SDK来下载数据集

#### 下载方法 
:modelscope-code[]{type="sdk"}
:modelscope-code[]{type="git"}

---
license: apache-2.0
---

# MultiWorld Dataset

## Dataset Summary

**MultiWorld** is a large-scale multi-agent multi-view video dataset collected for training video world models. It contains two complementary sources of data:

1. **It Takes Two Gameplay Dataset**: 100+ hours of real human gameplay from the cooperative action-adventure game *It Takes Two*, featuring dual-agent synchronized actions with distinct first-person viewpoints.
2. **RoboFactory Manipulation Dataset**: Multi-robot manipulation trajectories spanning 4 tasks with 2-4 agents and variable camera viewpoints, including both success and failure episodes.

This dataset is the official release accompanying the paper *"MultiWorld: Scalable Multi-Agent Multi-View Video World Models"*.

- **Homepage:** https://multi-world.github.io
- **Repository:** https://github.com/CIntellifusion/MultiWorld
- **Paper:** [arXiv:XXXX.XXXXX](https://arxiv.org/abs/XXXX.XXXXX)
---

## Dataset Details

### It Takes Two Gameplay

| Property | Value |
|----------|-------|
| **Total Duration** | 100+ hours |
| **Frame Rate** | 60 FPS |
| **Resolution** | 480 × 960 |
| **Agents** | 2 players |
| **Viewpoints** | 2 distinct first-person views per episode |
| **Actions** | Synchronized keyboard and mouse actions per agent |
| **Modality** | RGB video + discrete/continuous action vectors |

The gameplay videos are captured from real human players cooperating in the game. Each frame is accompanied by per-agent action labels capturing keyboard presses and mouse movements.

### RoboFactory Manipulation

| Property | Value |
|----------|-------|
| **Tasks** | 4 multi-robot manipulation tasks |
| **Agents** | 2–4 robots per task |
| **Viewpoints** | Variable camera configurations per task |
| **Resolution** | 256 × 320 |
| **Success Episodes** | 1,000 per task |
| **Failure Episodes** | 2,000 per task |
| **Modality** | RGB video + robot proprioception + actions |

Tasks include collaborative stacking, pushing, and pick-and-place scenarios. Both successful and failed trajectories are included to support learning robust world models and failure prediction.


---

### Possible Usage

The dataset is intended for research in:
- Video world models
- Multi-agent video generation 
- Multi-view consistent video generation.

---

### Contact

For questions about the dataset, please open an issue on the [GitHub repository](https://github.com/CIntellifusion/MultiWorld) or contact the authors.