---
title: Apriel-1.5-15b-Thinker-6bit-MLX
canonical_url: "https://www.modelscope.cn/models/mlx-community/Apriel-1.5-15b-Thinker-6bit-MLX"
md_url: "https://www.modelscope.cn/models/mlx-community/Apriel-1.5-15b-Thinker-6bit-MLX.md"
repository: mlx-community/Apriel-1.5-15b-Thinker-6bit-MLX
last_updated: 2025-10-10
license: mit
pipeline_tag: image-text-to-text
tasks:
  - image-text-to-text
model_type:
  - pixtral
architectures:
  - LlavaForConditionalGeneration
base_model:
  - ServiceNow-AI/Apriel-1.5-15b-Thinker
base_model_relation: quantized
library_name:
  - mlx
  - safetensors
  - pytorch
frameworks:
  - pytorch
language:
  - en
inference_backends:
  - "deploy_task vlm/text/emb"
  - "lmdeploy 0.9.1"
  - "lmdeploy_turbomind 0.9.1"
  - "sglang 0.5.2"
  - "vllm 0.9.2"
downloads: 70
stars: 0
tags:
  - mlx
  - apple-silicon
  - multimodal
  - vision-language
  - pixtral
  - llava
  - quantized
  - 6bit
---

# Apriel-1.5-15b-Thinker-6bit-MLX

> Apriel-1.5-15b-Thinker-6bit-MLX - mlx-community 在 ModelScope 开源的模型。Apriel-1.5-15B-Thinker — MLX Quantized (Apple Silicon)

mlx-community/Apriel-1.5-15b-Thinker-6bit-MLX 是 ModelScope 魔搭社区上的image-text-to-text模型，采用 mit 许可，基于 ServiceNow-AI/Apriel-1.5-15b-Thinker 构建，可用 deploy_task vlm/text/emb、lmdeploy 0.9.1、lmdeploy_turbomind 0.9.1 部署。

- **Repository**: mlx-community/Apriel-1.5-15b-Thinker-6bit-MLX
- **License**: mit
- **Tasks**: image-text-to-text
- **Base model**: ServiceNow-AI/Apriel-1.5-15b-Thinker
- **Inference backends**: deploy_task vlm/text/emb, lmdeploy 0.9.1, lmdeploy_turbomind 0.9.1, sglang 0.5.2, vllm 0.9.2
- **Tags**: mlx, apple-silicon, multimodal, vision-language, pixtral, llava, quantized, 6bit
- **Downloads**: 70
- **Stars**: 0
- **Last updated**: 2025-10-10

Source: https://www.modelscope.cn/models/mlx-community/Apriel-1.5-15b-Thinker-6bit-MLX

---

# Apriel-1.5-15B-Thinker — MLX Quantized (Apple Silicon)

**Format:** MLX (Apple Silicon)  
**Variants:** 6-bit (recommended)
**Base model:** ServiceNow-AI/Apriel-1.5-15B-Thinker  
**Architecture:** Pixtral-style LLaVA (vision encoder → 2-layer projector → decoder)  
**Intended use:** image understanding & grounded reasoning; document/chart/OCR-style tasks; math/coding Q&A with visual context.

> This repository provides **MLX-format** weights for Apple Silicon (M-series) built from the original Apriel-1.5-15B-Thinker release. It is optimized for **on-device** inference with small memory footprints and fast startup on macOS.

---

## 🔎 What is Apriel-1.5-15B-Thinker?

Apriel-1.5-15B-Thinker is a 15B **open-weights multimodal reasoning** model trained via a data-centric **mid-training** recipe rather than RLHF/RM. Starting from **Pixtral-12B** as the base, the authors apply:
1) **Depth Upscaling** (capacity expansion without pretraining from scratch),  
2) **Two-stage multimodal continual pretraining (CPT)** to build text + visual reasoning, and  
3) **High-quality SFT** with explicit reasoning traces across math, coding, science, and tool use.  
This approach delivers **frontier-level** capability on compact compute. :contentReference[oaicite:0]{index=0}

### Key reported results (original model)
- **AAI Index**: 52, **matching DeepSeek-R1-0528** at far lower compute. :contentReference[oaicite:1]{index=1}
- **Multimodal**: On 10 image benchmarks, **within ~5 points** of Gemini-2.5-Flash and Claude Sonnet-3.7 on average. :contentReference[oaicite:2]{index=2}
- Designed for **single-GPU / constrained deployment** scenarios. :contentReference[oaicite:3]{index=3}

> Notes above summarize the upstream paper; MLX quantization can slightly affect absolute scores. Always validate on your use case.

---

## 🏗️ Architecture (high level)

- **Backbone:** Pixtral-12B-Base-2409 adapted to a larger 15B decoder via **depth upscaling** (layers 40 → 48), then re-aligned with a **2-layer projection network** connecting the vision encoder and decoder. :contentReference[oaicite:4]{index=4}
- **Training stack:**
  - **CPT Stage-1:** mixed tokens (≈50% text, 20% replay, 30% multimodal) for foundational reasoning & image understanding; 32k context; cosine LR with warmup; all components unfrozen; checkpoint averaging. :contentReference[oaicite:5]{index=5}
  - **CPT Stage-2:** targeted synthetic visual tasks (reconstruction, visual matching, detection, counting) to strengthen **spatial/compositional/fine-grained** reasoning; vision encoder frozen; loss on responses for instruct data; 16k context. :contentReference[oaicite:6]{index=6}
  - **SFT:** curated instruction-response pairs with **explicit reasoning traces** (math, coding, science, tools). :contentReference[oaicite:7]{index=7}

---

## 💾 This MLX Release

- **Why MLX?** Native Apple-Silicon inference with small binaries, fast load, and low memory overhead.
- **What’s included:** `config.json`, `mlx_model*.safetensors` (sharded), tokenizer & processor files, and metadata for VLM pipelines.
- **Quantization options:**
  - **6-bit (recommended):** best balance of quality & memory.

> Tip: If you’re capacity-constrained on an M1/M2, try **6-bit** first;

---

## ⚙️ Quickstart (CLI)

```bash
# Basic image caption
python -m mlx_vlm.generate \
  --model <this-repo-id> \
  --image /path/to/image.jpg \
  --prompt "Describe this image." \
  --max-tokens 128 --temperature 0.0 --device mps