---
title: llama-3-chinese-8b-lora
canonical_url: "https://www.modelscope.cn/models/ChineseAlpacaGroup/llama-3-chinese-8b-lora"
md_url: "https://www.modelscope.cn/models/ChineseAlpacaGroup/llama-3-chinese-8b-lora.md"
repository: ChineseAlpacaGroup/llama-3-chinese-8b-lora
last_updated: 2024-04-29
license: "Apache License 2.0"
pipeline_tag: fill-mask
tasks:
  - fill-mask
model_type:
  - llama
parameters: 1.2B
tensor_type:
  - BF16
library_name:
  - safetensors
  - pytorch
frameworks:
  - Pytorch
language:
  - zh
  - en
downloads: 189
stars: 3
---

# llama-3-chinese-8b-lora

> llama-3-chinese-8b-lora - ChineseAlpacaGroup 在 ModelScope 开源的模型。Llama-3-Chinese-8B-LoRA

ChineseAlpacaGroup/llama-3-chinese-8b-lora 是 ModelScope 魔搭社区上的 1.2B 参数fill-mask模型，采用 Apache License 2.0 许可。

- **Repository**: ChineseAlpacaGroup/llama-3-chinese-8b-lora
- **License**: Apache License 2.0
- **Tasks**: fill-mask
- **Parameters**: 1.2B
- **Downloads**: 189
- **Stars**: 3
- **Last updated**: 2024-04-29

Source: https://www.modelscope.cn/models/ChineseAlpacaGroup/llama-3-chinese-8b-lora

---

# Llama-3-Chinese-8B-LoRA

<p align="center">
    <a href="https://github.com/ymcui/Chinese-LLaMA-Alpaca-3"><img src="https://ymcui.com/images/chinese-llama-alpaca-3-banner.png" width="600"/></a>
</p>

这个仓库包含了**Llama-3-Chinese-8B-LoRA**，它是在[Meta-Llama-3-8B](https://huggingface.co/meta-llama/Meta-Llama-3-8B)的基础上，使用了120GB的中文文本语料进行进一步预训练。

**注意：LoRA必须和原版[Meta-Llama-3-8B](https://huggingface.co/meta-llama/Meta-Llama-3-8B)进行合并才能得到完整模型。**

更多细节（性能、使用方法等）请参考GitHub项目页面：https://github.com/ymcui/Chinese-LLaMA-Alpaca-3

## 其他

- 完整模型：https://modelscope.cn/models/ChineseAlpacaGroup/llama-3-chinese-8b

- GGUF模型（llama.cpp兼容）：https://modelscope.cn/models/ChineseAlpacaGroup/llama-3-chinese-8b-gguf

- 关于本模型的提问，请通过 https://github.com/ymcui/Chinese-LLaMA-Alpaca-3 提交issue

----

This repository contains **Llama-3-Chinese-8B-LoRA**, which is further pre-trained on [Meta-Llama-3-8B](https://huggingface.co/meta-llama/Meta-Llama-3-8B) with 120 GB Chinese text corpora.

**Note: You must combine LoRA with the original [Meta-Llama-3-8B](https://huggingface.co/meta-llama/Meta-Llama-3-8B) to obtain full weight.**

Further details (performance, usage, etc.) should refer to GitHub project page: https://github.com/ymcui/Chinese-LLaMA-Alpaca-3


## Others

- For full model, please see: https://modelscope.cn/models/ChineseAlpacaGroup/llama-3-chinese-8b

- For GGUF model (llama.cpp compatible), please see: https://modelscope.cn/models/ChineseAlpacaGroup/llama-3-chinese-8b-gguf

- If you have questions/issues regarding this model, please submit an issue through https://github.com/ymcui/Chinese-LLaMA-Alpaca-3