---
title: realm-cc-news-pretrained-encoder
canonical_url: "https://www.modelscope.cn/models/google/realm-cc-news-pretrained-encoder"
md_url: "https://www.modelscope.cn/models/google/realm-cc-news-pretrained-encoder.md"
repository: google/realm-cc-news-pretrained-encoder
last_updated: 2025-04-21
license: apache-2.0
model_type:
  - realm
architectures:
  - RealmKnowledgeAugEncoder
library_name:
  - transformer
  - pytorch
frameworks:
  - pytorch
language:
  - en
downloads: 417
stars: 0
---

# realm-cc-news-pretrained-encoder

> realm-cc-news-pretrained-encoder - google 在 ModelScope 开源的模型。realm-cc-news-pretrained-encoder

google/realm-cc-news-pretrained-encoder 是 ModelScope 魔搭社区上的机器学习模型，采用 apache-2.0 许可。

- **Repository**: google/realm-cc-news-pretrained-encoder
- **License**: apache-2.0
- **Downloads**: 417
- **Stars**: 0
- **Last updated**: 2025-04-21

Source: https://www.modelscope.cn/models/google/realm-cc-news-pretrained-encoder

---

# realm-cc-news-pretrained-encoder

## Model description

The REALM checkpoint pretrained with CC-News as target corpus and Wikipedia as knowledge corpus, converted from the TF checkpoint provided by Google Language.

The original paper, code, and checkpoints can be found [here](https://github.com/google-research/language/tree/master/language/realm).

## Usage

```python
from transformers import RealmKnowledgeAugEncoder

encoder = RealmKnowledgeAugEncoder.from_pretrained("qqaatw/realm-cc-news-pretrained-encoder")
```