---
title: Magpie-DPO-100K-SML
canonical_url: "https://www.modelscope.cn/datasets/Magpie-Align/Magpie-DPO-100K-SML"
md_url: "https://www.modelscope.cn/datasets/Magpie-Align/Magpie-DPO-100K-SML.md"
repository: Magpie-Align/Magpie-DPO-100K-SML
last_updated: 2025-01-15
license: "Apache License 2.0"
storage_size: "636 MB"
downloads: 1356
stars: 0
---

# Magpie-DPO-100K-SML

> Magpie-DPO-100K-SML - Magpie-Align 在 ModelScope 开源的数据集。This dataset is still under internal assessment. Please use it with caution!

Magpie-Align/Magpie-DPO-100K-SML 是 ModelScope 魔搭社区上的数据集，存储大小 636 MB，采用 Apache License 2.0 许可。

- **Repository**: Magpie-Align/Magpie-DPO-100K-SML
- **License**: Apache License 2.0
- **Storage size**: 636 MB
- **Downloads**: 1356
- **Stars**: 0
- **Last updated**: 2025-01-15

Source: https://www.modelscope.cn/datasets/Magpie-Align/Magpie-DPO-100K-SML

---

This dataset is still under internal assessment. Please use it with caution!

To create this dataset, we first generate responses from the base model using URIAL as rejected. Then, we generate responses from 8B, 70B, and 405B models, and take the instruction-response pair with the highest reward as chosen.

### Other Magpie DPO Datasets
We observed that the following DPO datasets may have better performance after we burned a lot of GPU hours :)

|Model Name | Dataset | Type | Description |
|-------------|:-------|:-------|:-------|
| [Llama 3 8B Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct) | [Magpie-Air-DPO-100K](https://huggingface.co/datasets/Magpie-Align/Magpie-Air-DPO-100K-v0.1) | DPO | DPO dataset via Best-of-N sampling and rewards.
| [Llama 3 70B Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-70B-Instruct) | [Magpie-Pro-DPO-100K](https://huggingface.co/datasets/Magpie-Align/Magpie-Pro-DPO-100K-v0.1) | DPO | DPO dataset via Best-of-N sampling and rewards.
| [Llama 3.1 70B Instruct](https://huggingface.co/meta-llama/Meta-Llama-3.1-70B-Instruct) | [Magpie-Llama-3.1-Pro-DPO-100K](https://huggingface.co/datasets/Magpie-Align/Magpie-Llama-3.1-Pro-DPO-100K-v0.1) | DPO | DPO dataset via Best-of-N sampling and rewards.