---
title: glm-edge-4b-chat-gguf
canonical_url: "https://www.modelscope.cn/models/ZhipuAI/glm-edge-4b-chat-gguf"
md_url: "https://www.modelscope.cn/models/ZhipuAI/glm-edge-4b-chat-gguf.md"
repository: ZhipuAI/glm-edge-4b-chat-gguf
last_updated: 2026-01-20
license: other
pipeline_tag: text-generation
tasks:
  - text-generation
library_name:
  - gguf
language:
  - zh
  - en
downloads: 1381
stars: 1
tags:
  - glm
  - edge
  - gguf
---

# glm-edge-4b-chat-gguf

> glm-edge-4b-chat-gguf - ZhipuAI 在 ModelScope 开源的模型。Glm-Edge-Chat-4B-GGUF

ZhipuAI/glm-edge-4b-chat-gguf 是 ModelScope 魔搭社区上的text-generation模型，采用 other 许可。

- **Repository**: ZhipuAI/glm-edge-4b-chat-gguf
- **License**: other
- **Tasks**: text-generation
- **Tags**: glm, edge, gguf
- **Downloads**: 1381
- **Stars**: 1
- **Last updated**: 2026-01-20

Source: https://www.modelscope.cn/models/ZhipuAI/glm-edge-4b-chat-gguf

---

# Glm-Edge-Chat-4B-GGUF

中文阅读, 点击[这里](README_zh.md)

## Inference with Ollama

### Installation

The code for adapting this model is actively being integrated into the official `llama.cpp`. You can test it using the
following adapted version:

```bash
git clone https://github.com/piDack/llama.cpp -b support_glm_edge_model
cmake -B build -DGGML_CUDA=ON # Or enable other acceleration hardware
cmake --build build -- -j 
```

### Inference

After installation, you can start the GLM-Edge Chat model using the following command:

```shell
llama-cli -m <path>/model.gguf -p "<|user|>\nhi<|assistant|>\n" -ngl 999
```

In the command-line interface, you can interact with the model by entering your requests, and the model will provide the
corresponding responses.

## License

The usage of this model’s weights is subject to the terms outlined in the [LICENSE](LICENSE).