---
title: Qwen3.8-27B-Q4_K_M-GGUF
canonical_url: "https://www.modelscope.cn/models/Abiray/Qwen3.8-27B-Q4_K_M-GGUF"
md_url: "https://www.modelscope.cn/models/Abiray/Qwen3.8-27B-Q4_K_M-GGUF.md"
repository: Abiray/Qwen3.8-27B-Q4_K_M-GGUF
last_updated: 2026-08-14
license: apache-2.0
pipeline_tag: image-text-to-text
tasks:
  - image-text-to-text
base_model:
  - Qwen/Qwen3.8-27B
base_model_relation: quantized
library_name:
  - gguf
  - pytorch
frameworks:
  - pytorch
downloads: 8406
stars: 20
tags:
  - qwen
  - quantized
  - gguf
  - llama-cpp
  - vision
---

# Qwen3.8-27B-Q4_K_M-GGUF

> Qwen3.8-27B-Q4_K_M-GGUF - Abiray 在 ModelScope 开源的模型。Qwen3.8-27B GGUF (Vision-Language)

Abiray/Qwen3.8-27B-Q4_K_M-GGUF 是 ModelScope 魔搭社区上的image-text-to-text模型，采用 apache-2.0 许可，基于 Qwen/Qwen3.8-27B 构建。

- **Repository**: Abiray/Qwen3.8-27B-Q4_K_M-GGUF
- **License**: apache-2.0
- **Tasks**: image-text-to-text
- **Base model**: Qwen/Qwen3.8-27B
- **Tags**: qwen, quantized, gguf, llama-cpp, vision
- **Downloads**: 8406
- **Stars**: 20
- **Last updated**: 2026-08-14

Source: https://www.modelscope.cn/models/Abiray/Qwen3.8-27B-Q4_K_M-GGUF

---

# Qwen3.8-27B GGUF (Vision-Language)

This repository contains the GGUF format quantization of the [Qwen3.8-27B](https://huggingface.co/Qwen/Qwen3.8-27B) model, a native vision-language model.

The model has been quantized using `llama.cpp` (release [b10430](https://github.com/ggml-org/llama.cpp/releases/tag/b10430)) to the `Q4_K_M` format.

## File Details

*   **Model Name**: Qwen3.8-27B
*   **Quantization**: Q4_K_M
*   **Main Model**: `Qwen3.8-27B-Q4_K_M.gguf` (16.8 GB)
*   **Vision Adapter**: `mmproj-F16.gguf` (Required for vision/multimodal tasks)
*   **Quantization Tool**: llama.cpp (b10430)

## About Qwen3.8-27B
Qwen3.8-27B is the most capable generation in the Qwen open-model family, built on the architectural foundation of Qwen3.5. It is a native vision-language model that understands images and videos, delivering substantial gains across coding, professional work, research, and long-horizon agentic tasks. 

For more information, please visit the [original model card](https://huggingface.co/Qwen/Qwen3.8-27B).

## Usage

### llama.cpp (Text Only)
To run this model as a text-only model using `llama.cpp` from the command line:

```bash
./llama-cli -m Qwen3.8-27B-Q4_K_M.gguf -p "Write a Python function to merge two sorted linked lists." -n 5124
```
### llama.cpp (Vision-Language)
To utilize the vision capabilities, you must provide the mmproj file using the --mmproj flag:
```bash
./llama-cli -m Qwen3.8-27B-Q4_K_M.gguf \
  --mmproj mmproj-F16.gguf \
  --image path/to/your/image.jpg \
  -p "Describe the contents of this image."
```
### LM Studio / Ollama / GPT4All
This GGUF file is compatible with popular local LLM inference tools. When configuring the model in your preferred client, ensure you attach the mmproj-F16.gguf file in the "Vision Adapter" or "Multimedia Projection" setting to enable image processing.
### Acknowledgements
The original model was developed and released by the Qwen Team.