---
title: LFM3-1.7B-GGUF
canonical_url: "https://www.modelscope.cn/models/LiquidAI/LFM3-1.7B-GGUF"
md_url: "https://www.modelscope.cn/models/LiquidAI/LFM3-1.7B-GGUF.md"
repository: LiquidAI/LFM3-1.7B-GGUF
last_updated: 2026-10-29
license: other
pipeline_tag: text-generation
tasks:
- text-generation
base_model:
- LiquidAI/LFM3-1.7B
base_model_relation: quantized
library_name:
- gguf
- pytorch
frameworks:
- pytorch
language:
- en
- ar
- zh
- fr
- de
- it
- ja
- ko
- pt
- es
- vi
- th
- id
- hi
- ru
- pl
downloads: 331
stars: 4
tags:
- liquid
- lfm3
- gguf
- llama.cpp
---
# LFM3-1.7B-GGUF
> LFM3-1.7B-GGUF - LiquidAI 在 ModelScope 开源的模型。GGUF version of LFM3-1.7B for local inference on CPUs and GPUs.
LiquidAI/LFM3-1.7B-GGUF 是 ModelScope 魔搭社区上的text-generation模型，采用 other 许可，基于 LiquidAI/LFM3-1.7B 构建。
- **Repository**: LiquidAI/LFM3-1.7B-GGUF
- **License**: other
- **Tasks**: text-generation
- **Base model**: LiquidAI/LFM3-1.7B
- **Tags**: liquid, lfm3, gguf, llama.cpp
- **Downloads**: 331
- **Stars**: 4
- **Last updated**: 2026-10-29
Source: https://www.modelscope.cn/models/LiquidAI/LFM3-1.7B-GGUF
---
# LFM3-1.7B-GGUF
GGUF version of [LFM3-1.7B](https://huggingface.co/LiquidAI/LFM3-1.7B) for local inference on CPUs and GPUs.
Find architecture and usage details in the [original model card](https://huggingface.co/LiquidAI/LFM3-1.7B).
## How to run LFM3-1.7B
Recommended sampling: temperature 0.1, top_k 50, repeat penalty 1.1. For math and science: temperature 1.0, top_p 0.95, top_k 20.
- [Llama.app](https://llama.app) (**Use this model > Llama** in the menu), for macOS and Windows. Requires llama.cpp version [v0.8.0](https://github.com/ggml-org/llama.cpp/releases/tag/v0.8.0) or newer.
- [LM Studio](https://lmstudio.ai) (**Use this model > LM Studio** in the menu), for macOS, Windows and Linux. Requires LM Studio with llama.cpp engine 2.65.1 or newer.
- [Ollama](https://ollama.com) (`ollama run lfm3`), for macOS. Requires Ollama version [v0.40.12](https://github.com/ollama/ollama/releases/tag/v0.40.12) or newer.
## Use with llama.cpp
> [!NOTE]
> Supported in [llama.cpp](https://github.com/ggml-org/llama.cpp) [b11960](https://github.com/ggml-org/llama.cpp/releases/tag/b11960) ([v0.8.0](https://github.com/ggml-org/llama.cpp/releases/tag/v0.8.0)) and newer.
Add a quantization tag to pick a file.
```bash
llama-cli -hf LiquidAI/LFM3-1.7B-GGUF:Q4_K_M \
--temp 0.1 --top-k 50 --repeat-penalty 1.1
```
For math and science, use `--temp 1.0 --top-p 0.95 --top-k 20` instead. More options in the [llama.cpp guide](https://docs.liquid.ai/deployment/on-device/llama-cpp).
## QAD Q4_0 GGUF
The Q4_0 build in this repository is the Quantization-Aware Distillation (QAD) checkpoint,
[`LFM3-1.7B-QAD-Q4_0.gguf`](https://huggingface.co/LiquidAI/LFM3-1.7B-GGUF/blob/main/LFM3-1.7B-QAD-Q4_0.gguf).
It was trained to recover the accuracy lost to Q4_0 quantization.
Example usage with [llama.cpp](https://github.com/ggml-org/llama.cpp):
```bash
llama-cli -hf LiquidAI/LFM3-1.7B-GGUF \
--hf-file LFM3-1.7B-QAD-Q4_0.gguf \
--temp 0.1 --top-k 50 --repeat-penalty 1.1
```
API
Try
Docs
Blog