---
title: ProcessBench
canonical_url: "https://www.modelscope.cn/datasets/AI-ModelScope/ProcessBench"
md_url: "https://www.modelscope.cn/datasets/AI-ModelScope/ProcessBench.md"
repository: AI-ModelScope/ProcessBench
last_updated: 2024-12-27
license: "Apache License 2.0"
storage_size: "7.8 MB"
downloads: 1634
stars: 0
---

# ProcessBench

> ProcessBench - AI-ModelScope 在 ModelScope 开源的数据集。This repository contains the dataset of the ProcessBench benchmark proposed by Qwen Team.

AI-ModelScope/ProcessBench 是 ModelScope 魔搭社区上的数据集，存储大小 7.8 MB，采用 Apache License 2.0 许可。

- **Repository**: AI-ModelScope/ProcessBench
- **License**: Apache License 2.0
- **Storage size**: 7.8 MB
- **Downloads**: 1634
- **Stars**: 0
- **Last updated**: 2024-12-27

Source: https://www.modelscope.cn/datasets/AI-ModelScope/ProcessBench

---

# ProcessBench

This repository contains the dataset of the [ProcessBench](https://huggingface.co/papers/2412.06559) benchmark proposed by Qwen Team.

You can refer to our [GitHub repository](https://github.com/QwenLM/ProcessBench) for the evaluation code and the prompt templates we use in this work.

If you find this work relevant or helpful to your work, please kindly cite us:

```
@article{processbench,
  title={ProcessBench: Identifying Process Errors in Mathematical Reasoning}, 
  author={
    Chujie Zheng and Zhenru Zhang and Beichen Zhang and Runji Lin and Keming Lu and
    Bowen Yu and Dayiheng Liu and Jingren Zhou and Junyang Lin
  },
  journal={arXiv preprint arXiv:2412.06559},
  year={2024}
}
```

## Data Usage

You can use the following code to preview the dataset:

```python
import json
from datasets import load_dataset

dataset = load_dataset('Qwen/ProcessBench', split='gsm8k')
print(json.dumps(dataset[0], indent=2))

# Expected output:
"""
{
  "id": "gsm8k-0",
  "generator": "Qwen2-7B-Instruct",
  "problem": "Sue lives in a fun neighborhood...",
  "steps": [
    "To find out how many more pink plastic flamingos were out than...",
    ...
  ],
  "final_answer_correct": false,
  "label": 1
}
"""
```
