---
title: CPT-Eval-Math
canonical_url: "https://www.modelscope.cn/datasets/Tsinghuadhy/CPT-Eval-Math"
md_url: "https://www.modelscope.cn/datasets/Tsinghuadhy/CPT-Eval-Math.md"
repository: Tsinghuadhy/CPT-Eval-Math
chinese_name: "CPT 评测集 数学基准"
last_updated: 2026-05-31
license: MIT
storage_size: "900 KB"
downloads: 51
stars: 0
---

# CPT-Eval-Math

> CPT-Eval-Math - Tsinghuadhy 在 ModelScope 开源的数据集。Math reasoning evaluation suite used in Cognitive Pairwise Training (CPT) (paper §4.2).

Tsinghuadhy/CPT-Eval-Math 是 ModelScope 魔搭社区上的数据集，存储大小 900 KB，采用 MIT 许可。

- **Repository**: Tsinghuadhy/CPT-Eval-Math
- **License**: MIT
- **Storage size**: 900 KB
- **Downloads**: 51
- **Stars**: 0
- **Last updated**: 2026-05-31

Source: https://www.modelscope.cn/datasets/Tsinghuadhy/CPT-Eval-Math

---

# CPT-Eval-Math

Math reasoning evaluation suite used in [Cognitive Pairwise Training (CPT)](https://github.com/Tsinghua-dhy/CPT) (paper §4.2).

7 benchmarks used in the paper's main results:

| Folder         | Benchmark              | # items |
|----------------|------------------------|---------|
| `math500/`     | MATH-500               | 500     |
| `aime24/`      | AIME 2024              | 30      |
| `aime25/`      | AIME 2025              | 30      |
| `amc22/`       | AMC 2022               | 83      |
| `amc23/`       | AMC 2023               | 83      |
| `minervamath/` | Minerva-Math           | 272     |
| `olympiad/`    | OlympiadBench (math)   | 675     |

Each folder ships a single `test.jsonl` with one example per line.

## Schema

```json
{ "question": "...", "answer": "..." }
```

## Use

Pair this with [`eval/math/eval_math.sh`](https://github.com/Tsinghua-dhy/CPT)
in the main repo:

```bash
modelscope download --dataset Tsinghuadhy/CPT-Eval-Math --local_dir CPT/eval/dataset
cd CPT/eval/math
bash eval_math.sh Tsinghuadhy/CPT-RL-Qwen3-14B
```
