---
title: MANTA-1M
canonical_url: "https://www.modelscope.cn/datasets/LGAI-EXAONE/MANTA-1M"
md_url: "https://www.modelscope.cn/datasets/LGAI-EXAONE/MANTA-1M.md"
repository: LGAI-EXAONE/MANTA-1M
last_updated: 2025-09-19
license: cc-by-nc-4.0
storage_size: "1.8 GB"
downloads: 60
stars: 0
---

# MANTA-1M

> MANTA-1M - LGAI-EXAONE 在 ModelScope 开源的数据集。We introduce MANTA, an automated pipeline that generates high-quality large-scale instruction fine-tuning datasets from massive web corpora while preserving their diversity and scalability. By extracting structured…

LGAI-EXAONE/MANTA-1M 是 ModelScope 魔搭社区上的数据集，存储大小 1.8 GB，采用 cc-by-nc-4.0 许可。

- **Repository**: LGAI-EXAONE/MANTA-1M
- **License**: cc-by-nc-4.0
- **Storage size**: 1.8 GB
- **Downloads**: 60
- **Stars**: 0
- **Last updated**: 2025-09-19

Source: https://www.modelscope.cn/datasets/LGAI-EXAONE/MANTA-1M

---

<p align="center">
<img src="Manta.png" alt="Manta" width="50%">
</p>



## **Abstract**

We introduce **MANTA**, an automated pipeline that generates high-quality large-scale instruction fine-tuning datasets from massive web corpora while preserving their diversity and scalability. By extracting structured syllabi from web documents and leveraging high-performance LLMs, our approach enables highly effective query-response generation with minimal human intervention. Extensive experiments on 8B-scale LLMs demonstrate that fine-tuning on the MANTA-1M dataset significantly outperforms other massive dataset generation methodologies, particularly in knowledge-intensive tasks such as MMLU and MMLU-Pro, while also delivering superior performance across a broad spectrum of tasks. Moreover, MANTA supports seamless scalability by allowing the continuous integration of web corpus data, enabling expansion into domains requiring intensive knowledge.

## **Dataset Details**

This dataset is generated by [**EXAONE-3.5-32B-Instruct**](https://huggingface.co/LGAI-EXAONE/EXAONE-3.5-32B-Instruct) using MANTA method. Please refer to our paper for implementation details.

The dataset is divided into 11 major categories, with their respective proportions as follows. These proportions naturally reflect the domain distribution of documents on the web, as the instructions were created based on information extracted from a large-scale web source. 

| Domain | percent % |
| --- | --- |
| Mathematics | 17.37% |
| Social Sciences | 21.21% |
| Natural Sciences | 22.39% |
| Engineering | 5.31% |
| Economics and Business | 4.32% |
| Computer Science and Coding | 24.82% |
| Arts | 3.03% |
| Philosophy, Religion | 0.97% |
| History | 0.83% |
| Literature | 0.83% |
| Languages | 0.40% |

Additionally, to ensure the quality of each dataset, we have annotated them with complexity scores using the method described in [1].

[1] Yuan, Weizhe, et al. "Naturalreasoning: Reasoning in the wild with 2.8 m challenging questions." *arXiv preprint arXiv:2502.13124* (2025).

## **Usage**

```python
from datasets import load_dataset

dataset = load_dataset("LGAI-EXAONE/MANTA-1M")
```

## **Citation**

```json

```

## **License**

This dataset is released under the **CC-BY-NC-4.0** License.

## **Contact**

LG AI Research Technical Support: [**contact_us@lgresearch.ai**](mailto:contact_us@lgresearch.ai)
