---
title: EQA-PMR-large
canonical_url: "https://www.modelscope.cn/models/iic/EQA-PMR-large"
md_url: "https://www.modelscope.cn/models/iic/EQA-PMR-large.md"
repository: iic/EQA-PMR-large
last_updated: 2023-09-28
license: "Apache License 2.0"
model_type:
  - structbert
architectures:
  - RoBERTa_PMR
library_name:
  - pytorch
frameworks:
  - PyTorch
language:
  - en
domain:
  - nlp
downloads: 87
stars: 0
tags:
  - Alibaba
  - QA
  - "NeurIPS 2023"
  - "问答"
---

# EQA-PMR-large

> EQA-PMR-large - iic 在 ModelScope 开源的模型。EQA-PMR-large EQA-PMR-large is initialized with PMR-large and further fine-tuned on 6 Extractive Question Answering (EQA) training data from training split of MRQA.

iic/EQA-PMR-large 是 ModelScope 魔搭社区上的机器学习模型，采用 Apache License 2.0 许可。

- **Repository**: iic/EQA-PMR-large
- **License**: Apache License 2.0
- **Tags**: Alibaba, QA, NeurIPS 2023, 问答
- **Downloads**: 87
- **Stars**: 0
- **Last updated**: 2023-09-28

Source: https://www.modelscope.cn/models/iic/EQA-PMR-large

---

## EQA-PMR-large
EQA-PMR-large is initialized with [PMR-large](https://huggingface.co/DAMO-NLP-SG/PMR-large) and further fine-tuned on 6 Extractive Question Answering (EQA) training data from training split of [MRQA](https://aclanthology.org/D19-5801).

The model performance on the in-dev sets are:  

||  SQuAD | NewsQA | HotpotQA | NaturalQuestions | TriviaQA | SearchQA |
|--|-------|-------|-------|------------|--------|--------|
|RoBERTa-large (single-task model)|  94.2 | 73.8 | 81.6|83.3| 85.1 | 85.7 |
|PMR-large  (single-task model)|   94.5 | 74.0 | 83.6 | 83.8 | 85.1 | 88.3 | 
|EQA-PMR-large  (multi-task model)|   94.2 | 73.7 | 66.9 | 82.3 | 85.4 | 88.7 |

Note that the performance of RoBERTa-large and PMR-large are single-task fine-tuning, while EQA-PMR-large is a multi-task fine-tuned model. 
As it is fine-tuned on multiple datasets, we believe that EQA-PMR-large has a better generalization capability to other EQA tasks than PMR-large and RoBERTa-large.

### How to use
You can try the codes from [this repo](https://github.com/DAMO-NLP-SG/PMR/QA) for both training and inference.


### BibTeX entry and citation info
```bibtxt
@article{xu2022clozing,
  title={From Clozing to Comprehending: Retrofitting Pre-trained Language Model to Pre-trained Machine Reader},
  author={Xu, Weiwen and Li, Xin and Zhang, Wenxuan and Zhou, Meng and Bing, Lidong and Lam, Wai and Si, Luo},
  journal={arXiv preprint arXiv:2212.04755},
  year={2022}
}
```