---
title: arena-human-preference-55k
canonical_url: "https://www.modelscope.cn/datasets/lmarena-ai/arena-human-preference-55k"
md_url: "https://www.modelscope.cn/datasets/lmarena-ai/arena-human-preference-55k.md"
repository: lmarena-ai/arena-human-preference-55k
last_updated: 2025-04-21
license: "Apache License 2.0"
storage_size: "176 MB"
downloads: 951
stars: 0
---

# arena-human-preference-55k

> arena-human-preference-55k - lmarena-ai 在 ModelScope 开源的数据集。Dataset for Kaggle competition on predicting human preference on Chatbot Arena battles. The training dataset includes over 55,000 real-world user and LLM conversations and user preferences across…

lmarena-ai/arena-human-preference-55k 是 ModelScope 魔搭社区上的数据集，存储大小 176 MB，采用 Apache License 2.0 许可。

- **Repository**: lmarena-ai/arena-human-preference-55k
- **License**: Apache License 2.0
- **Storage size**: 176 MB
- **Downloads**: 951
- **Stars**: 0
- **Last updated**: 2025-04-21

Source: https://www.modelscope.cn/datasets/lmarena-ai/arena-human-preference-55k

---

Dataset for [Kaggle competition](https://www.kaggle.com/competitions/lmsys-chatbot-arena/overview) on predicting human preference on Chatbot Arena battles. 
The training dataset includes over 55,000 real-world user and LLM conversations and user preferences across over 70 state-of-the-art LLMs, such as GPT-4, Claude 2, Llama 2, Gemini, and Mistral models.
Each sample represents a battle consisting of 2 LLMs which answer the same question, with a user label of either prefer model A, prefer model B, tie, or tie (both bad).

### Citation
Please cite the following paper if you find our leaderboard or dataset helpful.
```
@misc{chiang2024chatbot,
    title={Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preference},
    author={Wei-Lin Chiang and Lianmin Zheng and Ying Sheng and Anastasios Nikolas Angelopoulos and Tianle Li and Dacheng Li and Hao Zhang and Banghua Zhu and Michael Jordan and Joseph E. Gonzalez and Ion Stoica},
    year={2024},
    eprint={2403.04132},
    archivePrefix={arXiv},
    primaryClass={cs.AI}
}
```