---
title: MiniMax-H3-Self-Generated-Dataset
canonical_url: "https://www.modelscope.cn/datasets/DiffSynth-Studio/MiniMax-H3-Self-Generated-Dataset"
md_url: "https://www.modelscope.cn/datasets/DiffSynth-Studio/MiniMax-H3-Self-Generated-Dataset.md"
repository: DiffSynth-Studio/MiniMax-H3-Self-Generated-Dataset
last_updated: 2026-09-08
license: apache-2.0
storage_size: "121 GB"
downloads: 273559
stars: 4
---

# MiniMax-H3-Self-Generated-Dataset

> MiniMax-H3-Self-Generated-Dataset - DiffSynth-Studio 在 ModelScope 开源的数据集。MiniMax-H3 Self-Generated Dataset

DiffSynth-Studio/MiniMax-H3-Self-Generated-Dataset 是 ModelScope 魔搭社区上的数据集，存储大小 121 GB，采用 apache-2.0 许可。

- **Repository**: DiffSynth-Studio/MiniMax-H3-Self-Generated-Dataset
- **License**: apache-2.0
- **Storage size**: 121 GB
- **Downloads**: 273559
- **Stars**: 4
- **Last updated**: 2026-09-08

Source: https://www.modelscope.cn/datasets/DiffSynth-Studio/MiniMax-H3-Self-Generated-Dataset

---

# MiniMax-H3 Self-Generated Dataset

A synthetic video-generation dataset of **11,029 clips** produced with
[MiniMax-H3](https://modelscope.cn/models/MiniMax/MiniMax-H3) through
[DiffSynth-Studio](https://github.com/modelscope/DiffSynth-Studio). Prompts are sourced
from [GokuScraper/seedance-2-prompts-datasets](https://huggingface.co/datasets/GokuScraper/seedance-2-prompts-datasets) and rewritten to fit the 5-second clip duration.

It contains two subsets:

| Subset | Clips | Task | Metadata |
|---|---|---|---|
| **T2VA** | 8,560 | text → video + audio | `metadata.jsonl` |
| **Ref2VA** | 2,469 | reference (image / video) + text → video + audio | `ref2va_metadata.jsonl` |

Both subsets share the same generation settings: 124 frames at 24 fps (~5.2 s),
30 inference steps, and per-clip resolutions derived from the source aspect ratio.

## Structure

```
.
├── metadata.jsonl            # T2VA subset
├── videos/                   # T2VA generated clips
│   ├── 000001.mp4
│   └── ... 008560.mp4
├── ref2va_metadata.jsonl     # Ref2VA subset
├── references/               # Ref2VA inputs (image or video)
│   ├── 000001.jpg
│   └── ... 002469.jpg|mp4
└── ref2va_videos/            # Ref2VA generated clips
    ├── 000001.mp4
    └── ... 002469.mp4
```

## T2VA subset

Each line of `metadata.jsonl` describes one clip:

```json
{
  "prompt": "integrated_multimodal_description: [Shot 1] Live-action, cinematic ...\n\noverall_soundscape: ...\n\nnon_diegetic_music: N/A",
  "video_path": "videos/000001.mp4",
  "height": 768,
  "width": 1344,
  "num_frames": 124,
  "num_inference_steps": 30
}
```

| Field | Type | Description |
|---|---|---|
| `prompt` | str | Structured H3 prompt |
| `video_path` | str | Path to the generated mp4, relative to the dataset root |
| `height` / `width` | int | Generated resolution in pixels |
| `num_frames` | int | Always 124 |
| `num_inference_steps` | int | Always 30 |

### Resolutions

Each clip keeps the aspect ratio of its source reference and is scaled to fill a
budget of `768 × 1344 = 1,032,192` pixels, with both dimensions rounded to a
multiple of 32.

| Resolution (W×H) | Clips |
|---|---|
| 1344 × 768 | 6,148 |
| 768 × 1344 | 1,239 |
| 864 × 1184 | 276 |
| 992 × 1024 | 203 |
| 1536 × 672 | 199 |
| 1184 × 864 | 185 |
| other (22 more) | 310 |

## Ref2VA subset

Each line of `ref2va_metadata.jsonl` describes one reference-conditioned clip:

```json
{
  "prompt": "subject_definitions: <Subject 1> is ... in <Picture 1> ...\n\nsummary: [reference generation] ...\n\nretention_analysis: ...\n\ndetailed_description: [Shot 1] ...\n\noverall_soundscape: ...\n\nnon_diegetic_music: N/A",
  "reference_kind": "image",
  "reference_labels": "Picture 1",
  "reference_path": "references/000001.jpg",
  "video_path": "ref2va_videos/000001.mp4",
  "height": 768,
  "width": 1344,
  "num_frames": 124,
  "num_inference_steps": 30
}
```

| Field | Type | Description |
|---|---|---|
| `prompt` | str | Structured H3 reference-generation prompt (subjects, retention analysis, shot description, soundscape) |
| `reference_kind` | str | `image` or `video` — the type of the conditioning reference |
| `reference_labels` | str | Reference tags used in the prompt: `Picture 1`, `Video 1`, or `Audio 1 + Video 1` |
| `reference_path` | str | Path to the reference file (`.jpg` for image, `.mp4` for video), relative to the dataset root |
| `video_path` | str | Path to the generated mp4, relative to the dataset root |
| `height` / `width` | int | Generated resolution in pixels |
| `num_frames` | int | Always 124 |
| `num_inference_steps` | int | Always 30 |

### Reference breakdown

| Reference | Labels | Clips |
|---|---|---|
| image | `Picture 1` | 1,783 |
| video | `Video 1` | 459 |
| video | `Audio 1 + Video 1` | 227 |