---
title: Ornith-1.0-35B-5bit
canonical_url: "https://www.modelscope.cn/models/mlx-community/Ornith-1.0-35B-5bit"
md_url: "https://www.modelscope.cn/models/mlx-community/Ornith-1.0-35B-5bit.md"
repository: mlx-community/Ornith-1.0-35B-5bit
last_updated: 2026-06-28
license: mit
pipeline_tag: image-text-to-text
tasks:
  - image-text-to-text
model_type:
  - qwen3_5_moe
architectures:
  - Qwen3_5MoeForConditionalGeneration
base_model:
  - deepreinforce-ai/Ornith-1.0-35B
base_model_relation: quantized
parameters: 6.9B
tensor_type:
  - U32
  - BF16
library_name:
  - mlx
  - safetensors
  - pytorch
frameworks:
  - pytorch
downloads: 37
stars: 0
tags:
  - mlx
  - mlx-vlm
  - vlm
  - moe
  - quantized
---

# Ornith-1.0-35B-5bit

> Ornith-1.0-35B-5bit - mlx-community 在 ModelScope 开源的模型。5-bit (group size 64, 5.636 bits/weight) MLX quantization of deepreinforce-ai/Ornith-1.0-35B, produced with mlx-vlm 0.6.3. Full multimodal: the vision encoder is preserved and quantized alongside the…

mlx-community/Ornith-1.0-35B-5bit 是 ModelScope 魔搭社区上的 6.9B 参数image-text-to-text模型，采用 mit 许可，基于 deepreinforce-ai/Ornith-1.0-35B 构建。

- **Repository**: mlx-community/Ornith-1.0-35B-5bit
- **License**: mit
- **Tasks**: image-text-to-text
- **Parameters**: 6.9B
- **Base model**: deepreinforce-ai/Ornith-1.0-35B
- **Tags**: mlx, mlx-vlm, vlm, moe, quantized
- **Downloads**: 37
- **Stars**: 0
- **Last updated**: 2026-06-28

Source: https://www.modelscope.cn/models/mlx-community/Ornith-1.0-35B-5bit

---

# Ornith-1.0-35B-5bit

5-bit (group size 64, **5.636 bits/weight**) MLX quantization of
[deepreinforce-ai/Ornith-1.0-35B](https://huggingface.co/deepreinforce-ai/Ornith-1.0-35B),
produced with `mlx-vlm` 0.6.3. Full multimodal: the vision encoder is preserved and
quantized alongside the language model. For Apple Silicon. Runs in `mlx-vlm` or any MLX app.

## Conversion note (MoE expert fusion)

Ornith stores its 256 MoE experts unfused (per-expert), but mlx-vlm's `qwen3_5_moe` loader expects
them fused/batched. A `sanitize` monkeypatch was required to stack the experts before conversion; without it the
conversion failed. This is a standard mlx-vlm 5-bit quant.

## Usage

```bash
uvx --from mlx-vlm mlx_vlm.generate \
  --model mlx-community/Ornith-1.0-35B-5bit --image image.png \
  --prompt "Describe this image." --max-tokens 512
```

```python
from mlx_vlm import load, generate
model, processor = load("mlx-community/Ornith-1.0-35B-5bit")
```

## Conversion check

Smoke-tested after conversion (`mlx_vlm.generate` on an image): coherent — correctly read an
evaluation bar chart, no repetition loop. **107.7 tok/s** generation, **987.5 tok/s** prompt,
**peak 26.8 GB** on a Macbook Pro M5 Max 128GB 40 GPU.

Refer to the original model card for architecture, benchmarks, license, and intended use.