---
title: msmarco-passage-ranking-corpus
canonical_url: "https://www.modelscope.cn/datasets/zyznull/msmarco-passage-ranking-corpus"
md_url: "https://www.modelscope.cn/datasets/zyznull/msmarco-passage-ranking-corpus.md"
repository: zyznull/msmarco-passage-ranking-corpus
chinese_name: "msmarco passage ranking原始数据集"
last_updated: 2022-09-29
license: "Apache License 2.0"
storage_size: "3.9 KB"
domain:
  - text
tasks:
  - sentence-similarity
language:
  - en
downloads: 373
stars: 0
---

# msmarco-passage-ranking-corpus

> msmarco-passage-ranking-corpus - zyznull 在 ModelScope 开源的数据集。msmarco passage ranking原始数据集

zyznull/msmarco-passage-ranking-corpus 是 ModelScope 魔搭社区上的sentence-similarity数据集，涉及 text 领域，存储大小 3.9 KB，采用 Apache License 2.0 许可。

- **Repository**: zyznull/msmarco-passage-ranking-corpus
- **License**: Apache License 2.0
- **Tasks**: sentence-similarity
- **Domain**: text
- **Storage size**: 3.9 KB
- **Downloads**: 373
- **Stars**: 0
- **Last updated**: 2022-09-29

Source: https://www.modelscope.cn/datasets/zyznull/msmarco-passage-ranking-corpus

---

## 数据集描述
MS MARCO Passage Ranking数据集，包含原始corpus集合，训练集query，与验证集query。

### 数据集简介
数据格式如下：
```
{
    "_id": string,
    "text": string
}
```

### 加载方法
```
from modelscope.msdatasets import MsDataset
ds =  MsDataset.load('msmarco-passage-corpus','zyznull')
train_query = ds['train_query'] # train queyr 集合
dev_query = ds['dev_query'] # dev query 集合
corpus = ds['corpus'] # corpus集合
```

### 数据集统计
| split      | Count  |
|------------|--------|
| Corpus     | 8841823|
| train_query| 502939 |
| dev_query  | 6980   |

### Clone with HTTP
* http://www.modelscope.cn/datasets/zyznull/msmarco-passage-ranking-corpus.git