---
title: longwriter-6k-filtered
canonical_url: "https://www.modelscope.cn/datasets/swift/longwriter-6k-filtered"
md_url: "https://www.modelscope.cn/datasets/swift/longwriter-6k-filtered.md"
repository: swift/longwriter-6k-filtered
last_updated: 2024-10-18
license: "Apache License 2.0"
storage_size: "13 MB"
domain:
  - size_categories
  - task_categories
  - language
tasks:
  - "1K<n<10K"
  - text-generation
  - zh
downloads: 1456
stars: 19
---

# longwriter-6k-filtered

> longwriter-6k-filtered - swift 在 ModelScope 开源的数据集。LongWriter-6k数据集的过滤版本

swift/longwriter-6k-filtered 是 ModelScope 魔搭社区上的1K<n<10K、text-generation、zh数据集，涉及 size_categories、task_categories、language 领域，存储大小 13 MB，采用 Apache License 2.0 许可。

- **Repository**: swift/longwriter-6k-filtered
- **License**: Apache License 2.0
- **Tasks**: 1K<n<10K, text-generation, zh
- **Domain**: size_categories, task_categories, language
- **Storage size**: 13 MB
- **Downloads**: 1456
- **Stars**: 19
- **Last updated**: 2024-10-18

Source: https://www.modelscope.cn/datasets/swift/longwriter-6k-filtered

---

# LongWriter-6k-Filtered


<p align="center">
  🤖 <a href="https://modelscope.cn/datasets/ZhipuAI/longwriter-6k-filtered" target="_blank">[LongWriter Dataset] </a> • 💻 <a href="https://github.com/THUDM/LongWriter" target="_blank">[Github Repo]</a> • 📃 <a href="https://arxiv.org/abs/2408.07055" target="_blank">[LongWriter Paper]</a> • 📃 <a href="https://arxiv.org/abs/2410.10210" target="_blank">[Tech report]</a>
</p>

**longwriter-6k-filtered** dataset contains 666 filtered examples SFT data with ultra-long output ranging from 2k-32k words in length (both English and Chinese) based on [LongWriter-6k](https://modelscope.cn/datasets/ZhipuAI/LongWriter-6k).  
The data can support training LLMs to extend their maximum output window size to 10,000+ words with low computational cost.

The tech report is available at [Minimum Tuning to Unlock Long Output from LLMs with High Quality Data as the Key](https://arxiv.org/abs/2410.10210)


### Filter Criteria
1. `Required Length` missing in the content of examples.

2. `Eval Length Score` higher than 80.
   About `Eval Length Score`, please refer to the [LongWriter Paper](https://arxiv.org/abs/2408.07055).


### 下载方法
:modelscope-code[]{type="sdk"}
:modelscope-code[]{type="git"}



### Citation

If you find our work useful, please consider citing LongWriter:

```
@article{bai2024longwriter,
  title={LongWriter: Unleashing 10,000+ Word Generation from Long Context LLMs}, 
  author={Yushi Bai and Jiajie Zhang and Xin Lv and Linzhi Zheng and Siqi Zhu and Lei Hou and Yuxiao Dong and Jie Tang and Juanzi Li},
  journal={arXiv preprint arXiv:2408.07055},
  year={2024}
}
```