---
title: bert-base-chinese
canonical_url: "https://www.modelscope.cn/models/google-bert/bert-base-chinese"
md_url: "https://www.modelscope.cn/models/google-bert/bert-base-chinese.md"
repository: google-bert/bert-base-chinese
last_updated: 2025-07-03
license: apache-2.0
pipeline_tag: fill-mask
tasks:
  - fill-mask
model_type:
  - bert
architectures:
  - BertForMaskedLM
parameters: 102.9M
tensor_type:
  - F32
library_name:
  - transformer
  - safetensors
  - tensorflow
  - pytorch
frameworks:
  - pytorch
language:
  - zh
downloads: 263114
stars: 55
---

# bert-base-chinese

> bert-base-chinese - google-bert 在 ModelScope 开源的模型。Table of Contents Model Details Uses Risks, Limitations and Biases Training Evaluation How to Get Started With the Model

google-bert/bert-base-chinese 是 ModelScope 魔搭社区上的 102.9M 参数fill-mask模型，采用 apache-2.0 许可。

- **Repository**: google-bert/bert-base-chinese
- **License**: apache-2.0
- **Tasks**: fill-mask
- **Parameters**: 102.9M
- **Downloads**: 263114
- **Stars**: 55
- **Last updated**: 2025-07-03

Source: https://www.modelscope.cn/models/google-bert/bert-base-chinese

---

# Bert-base-chinese

## Table of Contents
- [Model Details](#model-details)
- [Uses](#uses)
- [Risks, Limitations and Biases](#risks-limitations-and-biases)
- [Training](#training)
- [Evaluation](#evaluation)
- [How to Get Started With the Model](#how-to-get-started-with-the-model)


## Model Details

### Model Description

This model has been pre-trained for Chinese, training and random input masking has been applied independently to word pieces (as in the original BERT paper).

- **Developed by:** Google
- **Model Type:** Fill-Mask
- **Language(s):** Chinese
- **License:** Apache 2.0
- **Parent Model:** See the [BERT base uncased model](https://huggingface.co/bert-base-uncased) for more information about the BERT base model.

### Model Sources
- **GitHub repo**: https://github.com/google-research/bert/blob/master/multilingual.md
- **Paper:** [BERT](https://arxiv.org/abs/1810.04805)


## Uses

#### Direct Use

This model can be used for masked language modeling 



## Risks, Limitations and Biases
**CONTENT WARNING: Readers should be aware this section contains content that is disturbing, offensive, and can propagate historical and current stereotypes.**

Significant research has explored bias and fairness issues with language models (see, e.g., [Sheng et al. (2021)](https://aclanthology.org/2021.acl-long.330.pdf) and [Bender et al. (2021)](https://dl.acm.org/doi/pdf/10.1145/3442188.3445922)).


## Training

#### Training Procedure
* **type_vocab_size:** 2
* **vocab_size:** 21128
* **num_hidden_layers:** 12

#### Training Data
[More Information Needed]

## Evaluation

#### Results

[More Information Needed]


## How to Get Started With the Model
```python
from transformers import AutoTokenizer, AutoModelForMaskedLM

tokenizer = AutoTokenizer.from_pretrained("bert-base-chinese")

model = AutoModelForMaskedLM.from_pretrained("bert-base-chinese")

```
