---
title: llama-3-chinese-8b
canonical_url: "https://www.modelscope.cn/models/ChineseAlpacaGroup/llama-3-chinese-8b"
md_url: "https://www.modelscope.cn/models/ChineseAlpacaGroup/llama-3-chinese-8b.md"
repository: ChineseAlpacaGroup/llama-3-chinese-8b
last_updated: 2024-04-29
license: "Apache License 2.0"
pipeline_tag: fill-mask
tasks:
  - fill-mask
model_type:
  - llama
architectures:
  - LlamaForCausalLM
parameters: 8.0B
tensor_type:
  - F16
  - BF16
library_name:
  - safetensors
  - pytorch
frameworks:
  - Pytorch
language:
  - zh
  - en
inference_backends:
  - "deploy_task text/emb"
  - "lmdeploy 0.9.1"
  - "lmdeploy_turbomind 0.9.1"
  - "sglang 0.5.2"
  - "vllm 0.9.2"
downloads: 1961
stars: 6
---

# llama-3-chinese-8b

> llama-3-chinese-8b - ChineseAlpacaGroup 在 ModelScope 开源的模型。这个仓库包含了Llama-3-Chinese-8B，它是在Meta-Llama-3-8B的基础上，使用了120GB的中文文本语料进行进一步预训练。

ChineseAlpacaGroup/llama-3-chinese-8b 是 ModelScope 魔搭社区上的 8.0B 参数fill-mask模型，采用 Apache License 2.0 许可，可用 deploy_task text/emb、lmdeploy 0.9.1、lmdeploy_turbomind 0.9.1 部署。

- **Repository**: ChineseAlpacaGroup/llama-3-chinese-8b
- **License**: Apache License 2.0
- **Tasks**: fill-mask
- **Parameters**: 8.0B
- **Inference backends**: deploy_task text/emb, lmdeploy 0.9.1, lmdeploy_turbomind 0.9.1, sglang 0.5.2, vllm 0.9.2
- **Downloads**: 1961
- **Stars**: 6
- **Last updated**: 2024-04-29

Source: https://www.modelscope.cn/models/ChineseAlpacaGroup/llama-3-chinese-8b

---

# Llama-3-Chinese-8B

<p align="center">
    <a href="https://github.com/ymcui/Chinese-LLaMA-Alpaca-3"><img src="https://ymcui.com/images/chinese-llama-alpaca-3-banner.png" width="600"/></a>
</p>

这个仓库包含了**Llama-3-Chinese-8B**，它是在[Meta-Llama-3-8B](https://huggingface.co/meta-llama/Meta-Llama-3-8B)的基础上，使用了120GB的中文文本语料进行进一步预训练。

**注意：这是一个基座模型，不适用于对话、问答等任务。**

更多细节（性能、使用方法等）请参考GitHub项目页面：https://github.com/ymcui/Chinese-LLaMA-Alpaca-3

## 其他

- LoRA模型：https://modelscope.cn/models/ChineseAlpacaGroup/llama-3-chinese-8b-lora

- GGUF模型（llama.cpp兼容）：https://modelscope.cn/models/ChineseAlpacaGroup/llama-3-chinese-8b-gguf

- 关于本模型的提问，请通过 https://github.com/ymcui/Chinese-LLaMA-Alpaca-3 提交issue


----

This repository contains **Llama-3-Chinese-8B**, which is further pre-trained on [Meta-Llama-3-8B](https://huggingface.co/meta-llama/Meta-Llama-3-8B) with 120 GB Chinese text corpora.

**Note: this is a foundation model, which is not suitable for conversation, QA, etc.** 

Further details (performance, usage, etc.) should refer to GitHub project page: https://github.com/ymcui/Chinese-LLaMA-Alpaca-3


## Others

- For LoRA-only model, please see: https://modelscope.cn/models/ChineseAlpacaGroup/llama-3-chinese-8b-lora

- For GGUF model (llama.cpp compatible), please see: https://modelscope.cn/models/ChineseAlpacaGroup/llama-3-chinese-8b-gguf

- If you have questions/issues regarding this model, please submit an issue through https://github.com/ymcui/Chinese-LLaMA-Alpaca-3