---
title: Olmo-3-7B-Instruct-mxfp4-QAT
canonical_url: "https://www.modelscope.cn/models/mlx-community/Olmo-3-7B-Instruct-mxfp4-QAT"
md_url: "https://www.modelscope.cn/models/mlx-community/Olmo-3-7B-Instruct-mxfp4-QAT.md"
repository: mlx-community/Olmo-3-7B-Instruct-mxfp4-QAT
last_updated: 2026-04-24
pipeline_tag: text-generation
tasks:
  - text-generation
model_type:
  - olmo3
base_model:
  - allenai/Olmo-3-7B-Instruct
base_model_relation: quantized
parameters: 1.4B
tensor_type:
  - U32
  - BF16
  - U8
library_name:
  - mlx
  - safetensors
  - pytorch
frameworks:
  - pytorch
downloads: 8
stars: 0
tags:
  - mlx-lm-lora
---

# Olmo-3-7B-Instruct-mxfp4-QAT

> Olmo-3-7B-Instruct-mxfp4-QAT - mlx-community 在 ModelScope 开源的模型。This model was fine-tuned using mlx-lm-lora version 2.1.0.

mlx-community/Olmo-3-7B-Instruct-mxfp4-QAT 是 ModelScope 魔搭社区上的 1.4B 参数text-generation模型，基于 allenai/Olmo-3-7B-Instruct 构建。

- **Repository**: mlx-community/Olmo-3-7B-Instruct-mxfp4-QAT
- **Tasks**: text-generation
- **Parameters**: 1.4B
- **Base model**: allenai/Olmo-3-7B-Instruct
- **Tags**: mlx-lm-lora
- **Downloads**: 8
- **Stars**: 0
- **Last updated**: 2026-04-24

Source: https://www.modelscope.cn/models/mlx-community/Olmo-3-7B-Instruct-mxfp4-QAT

---

# MLX-LM-LoRA Model

This model was fine-tuned using [mlx-lm-lora](https://github.com/Goekdeniz-Guelmez/mlx-lm-lora) version 2.1.0.

## Model Details

- Base model: allenai/Olmo-3-7B-Instruct
- Model type: olmo3
- Training method: QAT + LoRA fine-tuning with MLX
- Fusion date: 2026-04-22 23:46:40

## Usage

This model can be loaded and used with the MLX framework.

## Command to recreate

```shell
python -m mlx_lm_lora.train \
--model allenai/Olmo-3-7B-Instruct \
--train-type lora \
--optimizer adamw \
--steps-per-report 1 \
--iters 100 \
--max-seq-length 4096 \
--adapter-path ./Olmo-3-7B-Instruct-mxfp4-QAT \
--data mlx-community/Dolci-Instruct-SFT-No-Tools-400K \
--train \
--qat-enable \
--qat-bits 4 \
--qat-group-size 64 \
--qat-mode mxfp4 \
--qat-start-step 1 \
--qat-interval 1
```