---
title: tulu-v3.1-mix-preview-4096-OLMoE
canonical_url: "https://www.modelscope.cn/datasets/allenai/tulu-v3.1-mix-preview-4096-OLMoE"
md_url: "https://www.modelscope.cn/datasets/allenai/tulu-v3.1-mix-preview-4096-OLMoE.md"
repository: allenai/tulu-v3.1-mix-preview-4096-OLMoE
last_updated: 2025-05-27
license: "Apache License 2.0"
storage_size: "812 MB"
downloads: 1613
stars: 0
---

# tulu-v3.1-mix-preview-4096-OLMoE

> tulu-v3.1-mix-preview-4096-OLMoE - allenai 在 ModelScope 开源的数据集。The SFT mix used is an expanded version of the Tulu v2 SFT mix with new additions for code, CodeFeedback-Filtered-Instruction, reasoning, MetaMathQA, and instruction following, No Robots and a…

allenai/tulu-v3.1-mix-preview-4096-OLMoE 是 ModelScope 魔搭社区上的数据集，存储大小 812 MB，采用 Apache License 2.0 许可。

- **Repository**: allenai/tulu-v3.1-mix-preview-4096-OLMoE
- **License**: Apache License 2.0
- **Storage size**: 812 MB
- **Downloads**: 1613
- **Stars**: 0
- **Last updated**: 2025-05-27

Source: https://www.modelscope.cn/datasets/allenai/tulu-v3.1-mix-preview-4096-OLMoE

---

# OLMoE SFT Mix

The SFT mix used is an expanded version of the [Tulu v2 SFT mix](https://huggingface.co/datasets/allenai/tulu-v2-sft-mixture-olmo-4096) with new additions for code, [CodeFeedback-Filtered-Instruction](https://huggingface.co/datasets/m-a-p/CodeFeedback-Filtered-Instruction), reasoning, [MetaMathQA](https://huggingface.co/datasets/meta-math/MetaMathQA), and instruction following, [No Robots](https://huggingface.co/datasets/HuggingFaceH4/no_robots) and a subset of [Daring Anteater](https://huggingface.co/datasets/nvidia/Daring-Anteater).

Please see the referenced datasets for the multiple licenses used in subsequent data.
We do not introduce any new data with this dataset.
Config for creation via [`open-instruct`](https://github.com/allenai/open-instruct/blob/main/open_instruct/mix_data.py):
```
dataset_mixer:
 allenai/tulu-v2-sft-mixture-olmo-4096: 1.0
 HuggingFaceH4/no_robots: 1.0
 meta-math/MetaMathQA: 0.25
 m-a-p/CodeFeedback-Filtered-Instruction: 1.0
 ai2-adapt-dev/daring-anteater-specialized: 1.0
max_seq_length: 4096
```

Reanming code:
```
def rename_messages(example):
     messages = example["messages"]
     new_messages = []
     for m in messages:
             new_messages.append({"role": m["role"], "content":m["content"].replace("OLMo","OLMoE")})
     example["messages"] = new_messages
     return example
```

Related datasets (for updated list, see [collection](https://huggingface.co/collections/allenai/tulu-3-data-mixes-66a944d48990fafa62c2c18c))
| Version | Name | Summary | Max Length | Model Name |
|---------|------|---------|------------|------------|
| v1 | [allenai/tulu-v1-sft-mixture](https://huggingface.co/datasets/allenai/tulu-v1-sft-mixture) | | | |
| v2 | [allenai/tulu-v2-sft-mixture](https://huggingface.co/datasets/allenai/tulu-v2-sft-mixture) | | - | |
| v2 | [allenai/tulu-v2-sft-mixture-olmo-2048](https://huggingface.co/datasets/allenai/tulu-v2-sft-mixture-olmo-2048) | | 2048 | OLMo-2048 |
| v3.0 | [allenai/tulu-v3.0-mix-preview-4096-OLMo](https://huggingface.co/datasets/allenai/tulu-v3.0-mix-preview-4096-OLMo) | Tulu 2 + Math/Code + No Robots| 4096 | OLMo |
| v3.0 | [allenai/tulu-v3.0-mix-preview-4096-OLMoE](https://huggingface.co/datasets/allenai/tulu-v3.0-mix-preview-4096-OLMoE) | OLMoE Name| 4096 | OLMoE |
| v3.1 | [**allenai/tulu-v3.1-mix-preview-4096-OLMoE**](https://huggingface.co/datasets/allenai/tulu-v3.1-mix-preview-4096-OLMoE) | Add specialized Daring Anteater | 4096 | OLMoE |