---
title: LFM3-VL-2B-GGUF
canonical_url: "https://www.modelscope.cn/models/LiquidAI/LFM3-VL-2B-GGUF"
md_url: "https://www.modelscope.cn/models/LiquidAI/LFM3-VL-2B-GGUF.md"
repository: LiquidAI/LFM3-VL-2B-GGUF
last_updated: 2026-10-29
license: other
pipeline_tag: image-text-to-text
tasks:
  - image-text-to-text
base_model:
  - LiquidAI/LFM3-VL-2B
base_model_relation: quantized
library_name:
  - gguf
  - pytorch
frameworks:
  - pytorch
language:
  - en
  - ar
  - zh
  - fr
  - de
  - it
  - ja
  - ko
  - pt
  - es
  - vi
  - th
  - id
  - hi
  - ru
  - pl
downloads: 370
stars: 3
tags:
  - liquid
  - lfm3
  - gguf
  - llama.cpp
---

# LFM3-VL-2B-GGUF

> LFM3-VL-2B-GGUF - LiquidAI 在 ModelScope 开源的模型。GGUF version of LFM3-VL-2B for local inference on CPUs and GPUs.

LiquidAI/LFM3-VL-2B-GGUF 是 ModelScope 魔搭社区上的image-text-to-text模型，采用 other 许可，基于 LiquidAI/LFM3-VL-2B 构建。

- **Repository**: LiquidAI/LFM3-VL-2B-GGUF
- **License**: other
- **Tasks**: image-text-to-text
- **Base model**: LiquidAI/LFM3-VL-2B
- **Tags**: liquid, lfm3, gguf, llama.cpp
- **Downloads**: 370
- **Stars**: 3
- **Last updated**: 2026-10-29

Source: https://www.modelscope.cn/models/LiquidAI/LFM3-VL-2B-GGUF

---

<div align="center">
  <img
    src="https://huggingface.co/LiquidAI/LFM3-1.7B/resolve/main/assets/liquid-ai-banner.webp"
    alt="Liquid AI"
    style="width: 100%; max-width: 100%; height: auto; display: block; margin: 0;"
  />
  <div align="center" style="display: flex; justify-content: center; align-items: center; gap: 1.25em; margin: 8px 0 1.7rem; padding: 0; line-height: 1.3;">
    <a href="https://console.liquid.ai/dashboard" style="display: inline-flex; align-items: center; gap: 6px;"><img src="https://huggingface.co/LiquidAI/LFM3-1.7B/resolve/main/assets/icons/api.svg" width="16" height="16" alt="" aria-hidden="true" style="display: block; flex: 0 0 16px; width: 16px; height: 16px; margin: 0;" /><strong>API</strong></a>
    <a href="https://playground.liquid.ai/" style="display: inline-flex; align-items: center; gap: 6px;"><img src="https://huggingface.co/LiquidAI/LFM3-1.7B/resolve/main/assets/icons/try.svg" width="16" height="16" alt="" aria-hidden="true" style="display: block; flex: 0 0 16px; width: 16px; height: 16px; margin: 0;" /><strong>Try</strong></a>
    <a href="https://docs.liquid.ai/lfm/getting-started/welcome" style="display: inline-flex; align-items: center; gap: 6px;"><img src="https://huggingface.co/LiquidAI/LFM3-1.7B/resolve/main/assets/icons/docs.svg" width="16" height="16" alt="" aria-hidden="true" style="display: block; flex: 0 0 16px; width: 16px; height: 16px; margin: 0;" /><strong>Docs</strong></a>
    <a href="https://www.liquid.ai/blog/lfm3" style="display: inline-flex; align-items: center; gap: 6px;"><img src="https://huggingface.co/LiquidAI/LFM3-1.7B/resolve/main/assets/icons/blog.svg" width="16" height="16" alt="" aria-hidden="true" style="display: block; flex: 0 0 16px; width: 16px; height: 16px; margin: 0;" /><strong>Blog</strong></a>
  </div>
</div>

# LFM3-VL-2B-GGUF

GGUF version of [LFM3-VL-2B](https://huggingface.co/LiquidAI/LFM3-VL-2B) for local inference on CPUs and GPUs.

Find architecture and usage details in the [original model card](https://huggingface.co/LiquidAI/LFM3-VL-2B).

## How to run LFM3-VL-2B
<hr style="margin: -0.7em 0 1.2em 0; border: 0; border-top: 1px solid rgba(127, 127, 127, 0.3);" />

Recommended sampling: temperature 0.1, top_k 50, top_p 1.0, min_p 0.0, repeat penalty 1.1.

- [Llama.app](https://llama.app) (**Use this model > Llama** in the menu), for macOS and Windows: image and video input. Requires llama.cpp version [v0.8.0](https://github.com/ggml-org/llama.cpp/releases/tag/v0.8.0) or newer. 
- [LM Studio](https://lmstudio.ai) (**Use this model > LM Studio** in the menu), for macOS, Windows and Linux: image input. Requires LM Studio with llama.cpp engine 2.65.1 or newer.
- [Ollama](https://ollama.com) `ollama run lfm3-vl`, for macOS: image input. Requires Ollama version [v0.40.12](https://github.com/ollama/ollama/releases/tag/v0.40.12) or newer.

## QAD Q4_0 GGUF
<hr style="margin: -0.7em 0 1.2em 0; border: 0; border-top: 1px solid rgba(127, 127, 127, 0.3);" />

The Q4_0 build in this repository is the Quantization-Aware Distillation (QAD) checkpoint,
[`LFM3-VL-2B-QAD-Q4_0.gguf`](https://huggingface.co/LiquidAI/LFM3-VL-2B-GGUF/blob/main/LFM3-VL-2B-QAD-Q4_0.gguf).
It was trained to recover the accuracy lost to Q4_0 quantization.