---
title: shiftproject_test
canonical_url: "https://www.modelscope.cn/datasets/vidore/shiftproject_test"
md_url: "https://www.modelscope.cn/datasets/vidore/shiftproject_test.md"
repository: vidore/shiftproject_test
last_updated: 2025-06-20
license: "Apache License 2.0"
storage_size: "380 MB"
downloads: 572
stars: 0
---

# shiftproject_test

> shiftproject_test - vidore 在 ModelScope 开源的数据集。Dataset Description This dataset is part of a topic-specific retrieval benchmark spanning multiple domains, which evaluates retrieval in more realistic industrial applications. It includes French documents from…

vidore/shiftproject_test 是 ModelScope 魔搭社区上的数据集，存储大小 380 MB，采用 Apache License 2.0 许可。

- **Repository**: vidore/shiftproject_test
- **License**: Apache License 2.0
- **Storage size**: 380 MB
- **Downloads**: 572
- **Stars**: 0
- **Last updated**: 2025-06-20

Source: https://www.modelscope.cn/datasets/vidore/shiftproject_test

---

## Dataset Description
This dataset is part of a topic-specific retrieval benchmark spanning multiple domains, which evaluates retrieval in more realistic industrial applications. 
It includes French documents from the [Shift Project](https://theshiftproject.org/) about the **environment**. 
Having a dataset in French allows *ViDoRe* to evaluate the multilingual ability of a retrieval model.


### Data Collection
We collected 5 large documents from the Shift Project reports, totalling 1,000 document pages per topic. We associated these with 100 questions and answers generated using Claude-3 Sonnet, a high-quality proprietary vision-language model.

### Data Curation

As the queries (and answers) are generated using a Vison Language Model, human annotators extensively filtered them for quality and relevance.

### Load the dataset 

```python
from datasets import load_dataset
ds = load_dataset("vidore/shiftproject_test", split="test")
```

### Dataset Structure

Here is an example of a dataset instance structure: 

```json
features:
  - name: query
    dtype: string
  - name: image
    dtype: image
  - name: image_filename
    dtype: string
  - name: answer
    dtype: string
  - name: page
    dtype: string
  - name: model
    dtype: string
  - name: prompt
    dtype: string
  - name: source
    dtype: string
```

## Citation Information

If you use this dataset in your research, please cite the original dataset as follows:

```latex
@misc{faysse2024colpaliefficientdocumentretrieval,
      title={ColPali: Efficient Document Retrieval with Vision Language Models}, 
      author={Manuel Faysse and Hugues Sibille and Tony Wu and Bilel Omrani and Gautier Viaud and Céline Hudelot and Pierre Colombo},
      year={2024},
      eprint={2407.01449},
      archivePrefix={arXiv},
      primaryClass={cs.IR},
      url={https://arxiv.org/abs/2407.01449}, 
}
```