---
title: LitSearch-NLP-Class
canonical_url: "https://www.modelscope.cn/datasets/yale-nlp/LitSearch-NLP-Class"
md_url: "https://www.modelscope.cn/datasets/yale-nlp/LitSearch-NLP-Class.md"
repository: yale-nlp/LitSearch-NLP-Class
last_updated: 2025-04-22
license: "Apache License 2.0"
storage_size: "133 MB"
downloads: 792
stars: 0
---

# LitSearch-NLP-Class

> LitSearch-NLP-Class - yale-nlp 在 ModelScope 开源的数据集。LitSearch: A Retrieval Benchmark for Scientific Literature Search

yale-nlp/LitSearch-NLP-Class 是 ModelScope 魔搭社区上的数据集，存储大小 133 MB，采用 Apache License 2.0 许可。

- **Repository**: yale-nlp/LitSearch-NLP-Class
- **License**: Apache License 2.0
- **Storage size**: 133 MB
- **Downloads**: 792
- **Stars**: 0
- **Last updated**: 2025-04-22

Source: https://www.modelscope.cn/datasets/yale-nlp/LitSearch-NLP-Class

---

# LitSearch: A Retrieval Benchmark for Scientific Literature Search

This dataset contains the query set and retrieval corpus for our paper **LitSearch: A Retrieval Benchmark for Scientific Literature Search**. We introduce LitSearch, a retrieval benchmark comprising 597 realistic literature search queries about recent ML and NLP papers. LitSearch is constructed using a combination of (1) questions generated by GPT-4 based on paragraphs containing inline citations from research papers and (2) questions about recently published papers, manually written by their authors. All LitSearch questions were manually examined or edited by experts to ensure high quality.

This dataset contains three configurations:

1. `query` containing 597 queries accomanied by gold paper IDs, specificity and quality annotations, and metadata about the source of the query.
2. `corpus_new` containing 6809 documents. We provide the extracted titles, abstracts and outgoing citation paper IDs.

Each configuration has a single 'full' split.

## Usage

You can load the configurations as follows:

```python
from datasets import load_dataset

query_data = load_dataset("yale-nlp/LitSearch-NLP-Class", "query", split="full")
corpus_clean_data = load_dataset("yale-nlp/LitSearch-NLP-Class", "corpus_new", split="full")
```