---
title: granite-34b-code-base-8k-GGUF
canonical_url: "https://www.modelscope.cn/models/AI-ModelScope/granite-34b-code-base-8k-GGUF"
md_url: "https://www.modelscope.cn/models/AI-ModelScope/granite-34b-code-base-8k-GGUF.md"
repository: AI-ModelScope/granite-34b-code-base-8k-GGUF
last_updated: 2026-06-26
license: apache-2.0
pipeline_tag: text-generation
tasks:
  - text-generation
library_name:
  - gguf
  - pytorch
frameworks:
  - pytorch
downloads: 1150
stars: 0
tags:
  - code
  - granite
  - gguf
---

# granite-34b-code-base-8k-GGUF

> granite-34b-code-base-8k-GGUF - AI-ModelScope 在 ModelScope 开源的模型。⚠️ DEPRECATION WARNING ⚠️ ⚠️ NOT RECOMMENDED FOR USE IN NEW PROJECTS ⚠️

AI-ModelScope/granite-34b-code-base-8k-GGUF 是 ModelScope 魔搭社区上的text-generation模型，采用 apache-2.0 许可。

- **Repository**: AI-ModelScope/granite-34b-code-base-8k-GGUF
- **License**: apache-2.0
- **Tasks**: text-generation
- **Tags**: code, granite, gguf
- **Downloads**: 1150
- **Stars**: 0
- **Last updated**: 2026-06-26

Source: https://www.modelscope.cn/models/AI-ModelScope/granite-34b-code-base-8k-GGUF

---

---

# ⚠️ DEPRECATION WARNING ⚠️
# ⚠️ NOT RECOMMENDED FOR USE IN NEW PROJECTS ⚠️

New applications/projects should use the latest mainline Granite language model family, whose code capabilities supercede this model. 
This model is being made available strictly for historical/scientific purposes. 
**Please see our [Granite Collections](https://huggingface.co/ibm-granite/collections) for the latest Granite releases.**

---

![image/png](https://cdn-uploads.huggingface.co/production/uploads/62cd5057674cdb524450093d/1hzxoPwqkBJXshKVVe6_9.png)

# ibm-granite/granite-34b-code-base-8k-GGUF
This is the Q4_K_M converted version of the original [`ibm-granite/granite-34b-code-base-8k`](https://huggingface.co/ibm-granite/granite-34b-code-base-8k).
Refer to the [original model card](https://huggingface.co/ibm-granite/granite-34b-code-base-8k) for more details.

## Use with llama.cpp
```shell
git clone https://github.com/ggerganov/llama.cpp
cd llama.cpp

# install
make

# run generation
./main -m granite-34b-code-base-8k-GGUF/granite-34b-code-base.Q4_K_M.gguf -n 128 -p "def generate_random(x: int):" --color
```