---
title: FailSafeQA
canonical_url: "https://www.modelscope.cn/datasets/LLM-Research/FailSafeQA"
md_url: "https://www.modelscope.cn/datasets/LLM-Research/FailSafeQA.md"
repository: LLM-Research/FailSafeQA
chinese_name: FailSafeQA
last_updated: 2025-03-10
license: "Apache License 2.0"
storage_size: "55 MB"
downloads: 1879
stars: 1
---

# FailSafeQA

> FailSafeQA - LLM-Research 在 ModelScope 开源的数据集。Benchmark data introduced in the paper: \ Expect the Unexpected: FailSafeQA Long Context for Finance (https://arxiv.org/abs/2502.06329)

LLM-Research/FailSafeQA 是 ModelScope 魔搭社区上的数据集，存储大小 55 MB，采用 Apache License 2.0 许可。

- **Repository**: LLM-Research/FailSafeQA
- **License**: Apache License 2.0
- **Storage size**: 55 MB
- **Downloads**: 1879
- **Stars**: 1
- **Last updated**: 2025-03-10

Source: https://www.modelscope.cn/datasets/LLM-Research/FailSafeQA

---

Benchmark data introduced in the paper: \
**Expect the Unexpected: FailSafeQA Long Context for Finance** ([https://arxiv.org/abs/2502.06329](https://arxiv.org/abs/2502.06329))

Dataset count: 220

<img src="FailSafeQA.png" width="700" title="FailSafeQA">

```json
{           
            "idx": int,
            "tokens": int,
            "context": string,
            "ocr_context": string,
            "answer": string,
            "query": string,
            "incomplete_query": string, 
            "out-of-domain_query": string, 
            "error_query": string, 
            "out-of-scope_query": string, 
            "citations": string,
            "citations_tokens": int
}
```

Tasks variety:
<img src="verb_dobj_base_new.png" width="400" title="FailSafeQA">
Root verbs and their direct objects from the first sentence of each normalized query, the top 20 verbs and their top five direct object.
Tasks types: 
- 83.0% question answering (QA)
- 17.0% involving text generation (TG)

To cite FailSafeQA, please use:
```
@misc{kiran2024failsafeqa,
      title={Expect the Unexpected: FailSafeQA Long Context for Finance}, 
      author={Kiran Kamble and Melisa Russak and Dmytro Mozolevskyi and Muayad Ali and Mateusz Russak and Waseem AlShikh},
      year={2024},
      eprint={2502.06329},
      archivePrefix={arXiv},
      primaryClass={cs.CL}
}
```