---
title: Qwen3.8-27B-abliterated-GGUF
canonical_url: "https://www.modelscope.cn/models/douyamv/Qwen3.8-27B-abliterated-GGUF"
md_url: "https://www.modelscope.cn/models/douyamv/Qwen3.8-27B-abliterated-GGUF.md"
repository: douyamv/Qwen3.8-27B-abliterated-GGUF
last_updated: 2026-08-15
license: apache-2.0
pipeline_tag: text-generation
tasks:
  - text-generation
base_model:
  - Qwen/Qwen3.8-27B
base_model_relation: quantized
library_name:
  - gguf
language:
  - en
  - zh
downloads: 4102
stars: 20
tags:
  - qwen
  - qwen3
  - gguf
  - abliterated
  - uncensored
  - quantized
  - llama-cpp
  - ollama
---

# Qwen3.8-27B-abliterated-GGUF

> Qwen3.8-27B-abliterated-GGUF - douyamv 在 ModelScope 开源的模型。Qwen3.8-27B-abliterated-GGUF

douyamv/Qwen3.8-27B-abliterated-GGUF 是 ModelScope 魔搭社区上的text-generation模型，采用 apache-2.0 许可，基于 Qwen/Qwen3.8-27B 构建。

- **Repository**: douyamv/Qwen3.8-27B-abliterated-GGUF
- **License**: apache-2.0
- **Tasks**: text-generation
- **Base model**: Qwen/Qwen3.8-27B
- **Tags**: qwen, qwen3, gguf, abliterated, uncensored, quantized, llama-cpp, ollama
- **Downloads**: 4102
- **Stars**: 20
- **Last updated**: 2026-08-15

Source: https://www.modelscope.cn/models/douyamv/Qwen3.8-27B-abliterated-GGUF

---

# Qwen3.8-27B-abliterated-GGUF

<p>
  <a href="https://huggingface.co/Qwen/Qwen3.8-27B"><img src="https://img.shields.io/badge/Base_Model-Qwen3.8--27B-blue" alt="Base Model"></a>
  <a href="https://huggingface.co/Qwen/Qwen3.8-27B/blob/main/LICENSE"><img src="https://img.shields.io/badge/License-Apache_2.0-green" alt="License"></a>
  <img src="https://img.shields.io/badge/Type-Abliterated-red" alt="Abliterated">
  <img src="https://img.shields.io/badge/Format-GGUF-purple" alt="GGUF">
</p>

GGUF quantized versions of the [abliterated (uncensored) Qwen3.8-27B](https://huggingface.co/douyamv/Qwen3.8-27B-abliterated) for use with [llama.cpp](https://github.com/ggml-org/llama.cpp), [Ollama](https://ollama.com/), [LM Studio](https://lmstudio.ai/), and other GGUF-compatible engines.

## Available Quantizations

| Filename | Quant Type | Size | Description |
|---|---|---|---|
| `qwen3.8-27b-abliterated-q8_0.gguf` | Q8_0 | ~28 GB | Virtually lossless; best quality |
| `qwen3.8-27b-abliterated-q6_k.gguf` | Q6_K | ~21 GB | Very high quality, near-lossless |
| `qwen3.8-27b-abliterated-q5_k_m.gguf` | Q5_K_M | ~19 GB | High quality; recommended balance |
| `qwen3.8-27b-abliterated-q4_k_m.gguf` | Q4_K_M | ~16 GB | Good quality; best for most users |
| `qwen3.8-27b-abliterated-q3_k_m.gguf` | Q3_K_M | ~13 GB | Medium quality; usable |
| `qwen3.8-27b-abliterated-q2_k.gguf` | Q2_K | ~7.9 GB | Lowest quality; for constrained VRAM |

## What is Abliteration?

This model has the "refusal direction" removed from its weights, allowing unrestricted conversations. The abliteration technique projects out the refusal direction from `self_attn.o_proj` and `mlp.down_proj` weights across all layers. See [douyamv/Qwen3.8-27B-abliterated](https://huggingface.co/douyamv/Qwen3.8-27B-abliterated) for details.

## Quickstart

### llama.cpp

```bash
./llama-cli -m qwen3.8-27b-abliterated-q4_k_m.gguf -p "Hello, tell me about yourself" -n 512
```

### Ollama

Create a `Modelfile`:
```
FROM ./qwen3.8-27b-abliterated-q4_k_m.gguf
TEMPLATE """{{ .Prompt }}"""
PARAMETER stop "<|im_end|>"
```

```bash
ollama create qwen3.8-27b-abliterated -f Modelfile
ollama run qwen3.8-27b-abliterated
```

### LM Studio

Download any GGUF file and open it directly in [LM Studio](https://lmstudio.ai/).

## Disclaimer

This model is provided for research and educational purposes. The removal of safety guardrails means the model may generate content that the original model would refuse. Users are responsible for ensuring appropriate and ethical use.

## Base Model Information

- **Model:** Qwen3.8-27B
- **Parameters:** 27.78B
- **Architecture:** Hybrid (Gated DeltaNet + Gated Attention)
- **Context Length:** 262,144 tokens (extensible to 1M+)
- **License:** Apache 2.0

## Credits

- Original model by [Qwen Team](https://huggingface.co/Qwen)
- Abliteration & quantization by [douyamv](https://huggingface.co/douyamv)

## Related Models

- [douyamv/Qwen3.8-27B-GGUF](https://huggingface.co/douyamv/Qwen3.8-27B-GGUF) — GGUF quantizations (Q2_K to Q8_0)
- [douyamv/Qwen3.8-27B-FP8](https://huggingface.co/douyamv/Qwen3.8-27B-FP8) — FP8 quantized safetensors
- [douyamv/Qwen3.8-27B-abliterated](https://huggingface.co/douyamv/Qwen3.8-27B-abliterated) — Abliterated safetensors (BF16)