---
title: Ternary-Bonsai-2-27B-gguf-dev
canonical_url: "https://www.modelscope.cn/models/prism-ml/Ternary-Bonsai-2-27B-gguf-dev"
md_url: "https://www.modelscope.cn/models/prism-ml/Ternary-Bonsai-2-27B-gguf-dev.md"
repository: prism-ml/Ternary-Bonsai-2-27B-gguf-dev
last_updated: 2026-09-18
license: apache-2.0
pipeline_tag: text-generation
tasks:
  - text-generation
base_model:
  - Qwen/Qwen3.8-27B
base_model_relation: quantized
library_name:
  - gguf
  - pytorch
frameworks:
  - pytorch
downloads: 66
stars: 1
tags:
  - ternary
  - 2-bit
  - gguf
  - llama-cpp
  - prismml
  - bonsai
---

# Ternary-Bonsai-2-27B-gguf-dev

> Ternary-Bonsai-2-27B-gguf-dev - prism-ml 在 ModelScope 开源的模型。Bonsai 2 27B, Q20 (testing build)

prism-ml/Ternary-Bonsai-2-27B-gguf-dev 是 ModelScope 魔搭社区上的text-generation模型，采用 apache-2.0 许可，基于 Qwen/Qwen3.8-27B 构建。

- **Repository**: prism-ml/Ternary-Bonsai-2-27B-gguf-dev
- **License**: apache-2.0
- **Tasks**: text-generation
- **Base model**: Qwen/Qwen3.8-27B
- **Tags**: ternary, 2-bit, gguf, llama-cpp, prismml, bonsai
- **Downloads**: 66
- **Stars**: 1
- **Last updated**: 2026-09-18

Source: https://www.modelscope.cn/models/prism-ml/Ternary-Bonsai-2-27B-gguf-dev

---

# Bonsai 2 27B, Q2_0 (testing build)

The `Q2_0` packing of Bonsai 2 27B, kept separate until upstream support lands.

Bonsai 2 needs an activation transform that currently only exists in our
[llama.cpp fork](https://github.com/PrismML-Eng/llama.cpp). Stock llama.cpp will load this file
anyway, since it knows the `Q2_0` type and the `qwen35` architecture, and outputs gibberish with no
warning. The main repo's `PQ2_0` and `PTQ1_0` use types stock llama.cpp does not know, so it stops
with an error rather than running them. That is why they ship there and this one does not.

It is here for testing, kernel work, and upstreaming. It moves to the main repo once that lands.

**For normal use:**
[Ternary-Bonsai-2-27B-gguf](https://huggingface.co/prism-ml/Ternary-Bonsai-2-27B-gguf), or
[Ternary-Bonsai-2-27B-mlx-2bit](https://huggingface.co/prism-ml/Ternary-Bonsai-2-27B-mlx-2bit) on
Apple Silicon. Setup for every backend:
[Bonsai-demo](https://github.com/PrismML-Eng/Bonsai-demo).

**contact@prismml.com**