---
title: PRIMERA-multinews
canonical_url: "https://www.modelscope.cn/models/LLM-Research/PRIMERA-multinews"
md_url: "https://www.modelscope.cn/models/LLM-Research/PRIMERA-multinews.md"
repository: LLM-Research/PRIMERA-multinews
last_updated: 2024-09-08
pipeline_tag: text2text-generation
tasks:
  - text2text-generation
model_type:
  - led
architectures:
  - LEDForConditionalGeneration
library_name:
  - tensorflow
  - pytorch
frameworks:
  - pytorch
downloads: 2144
stars: 0
---

# PRIMERA-multinews

> PRIMERA-multinews - LLM-Research 在 ModelScope 开源的模型。HF-version model for PRIMERA: Pyramid-based Masked Sentence Pre-training for Multi-document Summarization (ACL 2022). The original code can be found here. You can find the script and notebook to…

- **Repository**: LLM-Research/PRIMERA-multinews
- **Tasks**: text2text-generation
- **Downloads**: 2144
- **Stars**: 0
- **Last updated**: 2024-09-08

Source: https://www.modelscope.cn/models/LLM-Research/PRIMERA-multinews

---

HF-version model for PRIMERA: Pyramid-based Masked Sentence Pre-training for Multi-document Summarization (ACL 2022). 



The original code can be found [here](https://github.com/allenai/PRIMER). You can find the script and notebook to train/evaluate the model in the original github repo.



* Note: due to the difference between the implementations of the original Longformer and the Huggingface LED model, the results of converted models are slightly different. We run a sanity check on both fine-tuned and non fine-tuned models, and show the results below:



| Model | Rouge-1 | Rouge-2 | Rouge-L |

| --- | ----------- |----------- |----------- |

| PRIMERA | 42.0 | 13.6 | 20.8| 

| PRIMERA-hf | 41.7 |13.6 | 20.5|

| PRIMERA(finetuned) | 49.9 | 21.1 | 25.9|

| PRIMERA-hf(finetuned) | 49.9 | 20.9 | 25.8|



You can use it by 

```

from transformers import (

    AutoTokenizer,

    LEDConfig,

    LEDForConditionalGeneration,

)

tokenizer = AutoTokenizer.from_pretrained('allenai/PRIMERA')

config=LEDConfig.from_pretrained('allenai/PRIMERA')

model = LEDForConditionalGeneration.from_pretrained('allenai/PRIMERA')

```