---
title: arena-hard-auto
canonical_url: "https://www.modelscope.cn/datasets/lmarena-ai/arena-hard-auto"
md_url: "https://www.modelscope.cn/datasets/lmarena-ai/arena-hard-auto.md"
repository: lmarena-ai/arena-hard-auto
last_updated: 2025-05-02
license: "Apache License 2.0"
storage_size: "3.1 GB"
downloads: 1276
stars: 0
---

# arena-hard-auto

> arena-hard-auto - lmarena-ai 在 ModelScope 开源的数据集。Repo for storing pre-generated model answers and judgment for Arena-Hard-v0.1 Arena-Hard-v2.0-Preview

lmarena-ai/arena-hard-auto 是 ModelScope 魔搭社区上的数据集，存储大小 3.1 GB，采用 Apache License 2.0 许可。

- **Repository**: lmarena-ai/arena-hard-auto
- **License**: Apache License 2.0
- **Storage size**: 3.1 GB
- **Downloads**: 1276
- **Stars**: 0
- **Last updated**: 2025-05-02

Source: https://www.modelscope.cn/datasets/lmarena-ai/arena-hard-auto

---

# Arena-Hard-Auto

Repo for storing pre-generated model answers and judgment for
- Arena-Hard-v0.1
- Arena-Hard-v2.0-Preview

Repo -> https://github.com/lmarena/arena-hard-auto

Paper -> https://arxiv.org/abs/2406.11939

## Citation
The code in this repository is developed from the papers below. Please cite it if you find the repository helpful.
```
@article{li2024crowdsourced,
  title={From Crowdsourced Data to High-Quality Benchmarks: Arena-Hard and BenchBuilder Pipeline},
  author={Li, Tianle and Chiang, Wei-Lin and Frick, Evan and Dunlap, Lisa and Wu, Tianhao and Zhu, Banghua and Gonzalez, Joseph E and Stoica, Ion},
  journal={arXiv preprint arXiv:2406.11939},
  year={2024}
}
@misc{arenahard2024,
    title = {From Live Data to High-Quality Benchmarks: The Arena-Hard Pipeline},
    url = {https://lmsys.org/blog/2024-04-19-arena-hard/},
    author = {Tianle Li*, Wei-Lin Chiang*, Evan Frick, Lisa Dunlap, Banghua Zhu, Joseph E. Gonzalez, Ion Stoica},
    month = {April},
    year = {2024}
}
```