---
title: prosparse-llama-2-13b-gguf
canonical_url: "https://www.modelscope.cn/models/AI-ModelScope/prosparse-llama-2-13b-gguf"
md_url: "https://www.modelscope.cn/models/AI-ModelScope/prosparse-llama-2-13b-gguf.md"
repository: AI-ModelScope/prosparse-llama-2-13b-gguf
last_updated: 2024-09-02
license: llama2
pipeline_tag: feature-extraction
tasks:
  - feature-extraction
model_type:
  - sparsellama
architectures:
  - SparseLlamaForCausalLM
library_name:
  - gguf
  - pytorch
frameworks:
  - pytorch
language:
  - en
downloads: 2204
stars: 0
tags:
  - gguf
---

# prosparse-llama-2-13b-gguf

> prosparse-llama-2-13b-gguf - AI-ModelScope 在 ModelScope 开源的模型。ProSparse-LLaMA-2-13B-GGUF

AI-ModelScope/prosparse-llama-2-13b-gguf 是 ModelScope 魔搭社区上的feature-extraction模型，采用 llama2 许可。

- **Repository**: AI-ModelScope/prosparse-llama-2-13b-gguf
- **License**: llama2
- **Tasks**: feature-extraction
- **Tags**: gguf
- **Downloads**: 2204
- **Stars**: 0
- **Last updated**: 2024-09-02

Source: https://www.modelscope.cn/models/AI-ModelScope/prosparse-llama-2-13b-gguf

---

# ProSparse-LLaMA-2-13B-GGUF

- Original model: [SparseLLM/ProSparse-LLaMA-2-13B](https://huggingface.co/SparseLLM/prosparse-llama-2-13b)
- Converted & distributed by: [THUNLP](https://nlp.csai.tsinghua.edu.cn/), [ModelBest](modelbest.cn), and [PowerInfer](https://huggingface.co/PowerInfer)

This model is the downstream distribution of [SparseLLM/ProSparse-LLaMA-2-13B](https://huggingface.co/SparseLLM/prosparse-llama-2-13b) in PowerInfer GGUF format consisting of the LLM model weights and predictor weights.

### Citation

Please kindly cite using the following BibTeX:

```bibtex
@article{song2024prosparse,
  title={{ProSparse}: Introducing and Enhancing Intrinsic Activation Sparsity within Large Language Models},
  author={Song, Chenyang and Han, Xu and Zhang, Zhengyan and Hu, Shengding and Shi, Xiyu and Li, Kuai and Chen, Chen and Liu, Zhiyuan and Li, Guangli and Yang, Tao and Sun, Maosong},
  year={2024},
  journal={arXiv preprint arXiv:2402.13516},
  url={https://arxiv.org/pdf/2402.13516.pdf}
}
```