---
title: Mythos-nano-GGUF
canonical_url: "https://www.modelscope.cn/models/AI-ModelScope/Mythos-nano-GGUF"
md_url: "https://www.modelscope.cn/models/AI-ModelScope/Mythos-nano-GGUF.md"
repository: AI-ModelScope/Mythos-nano-GGUF
last_updated: 2026-07-14
license: mit
pipeline_tag: text-generation
tasks:
  - text-generation
base_model:
  - squ11z1/Mythos-nano
base_model_relation: quantized
library_name:
  - gguf
  - pytorch
frameworks:
  - pytorch
downloads: 181
stars: 0
tags:
  - gguf
  - reasoning
  - math
  - code
  - qwen2
  - mythos-nano
---

# Mythos-nano-GGUF

> Mythos-nano-GGUF - AI-ModelScope 在 ModelScope 开源的模型。GGUF quantizations of squ11z1/Mythos-nano (3B reasoning model, Qwen2-class) for llama.cpp / Ollama / LM Studio.

AI-ModelScope/Mythos-nano-GGUF 是 ModelScope 魔搭社区上的text-generation模型，采用 mit 许可，基于 squ11z1/Mythos-nano 构建。

- **Repository**: AI-ModelScope/Mythos-nano-GGUF
- **License**: mit
- **Tasks**: text-generation
- **Base model**: squ11z1/Mythos-nano
- **Tags**: gguf, reasoning, math, code, qwen2, mythos-nano
- **Downloads**: 181
- **Stars**: 0
- **Last updated**: 2026-07-14

Source: https://www.modelscope.cn/models/AI-ModelScope/Mythos-nano-GGUF

---

# Mythos-nano — GGUF

GGUF quantizations of [**squ11z1/Mythos-nano**](https://huggingface.co/squ11z1/Mythos-nano)
(3B reasoning model, Qwen2-class) for `llama.cpp` / Ollama / LM Studio.

> ⚠️ **Abliterated (uncensored):** the refusal direction has been removed — this model will
> not decline requests a safety-tuned model normally would. Use responsibly, at your own risk.
> 🚨 Not trained for tool-calling / agentic coding — best on competition-style math & code.

## Quants

| File | Quant | Size | Notes |
|---|---|---|---|
| `mythos-nano-Q2_K.gguf`   | Q2_K   | 1.27 GB | smallest, lowest quality |
| `mythos-nano-Q3_K_S.gguf` | Q3_K_S | 1.45 GB | |
| `mythos-nano-Q3_K_M.gguf` | Q3_K_M | 1.59 GB | |
| `mythos-nano-Q3_K_L.gguf` | Q3_K_L | 1.71 GB | |
| `mythos-nano-Q4_K_S.gguf` | Q4_K_S | 1.83 GB | |
| `mythos-nano-Q4_K_M.gguf` | Q4_K_M | 1.93 GB | **recommended balance** |
| `mythos-nano-Q5_K_S.gguf` | Q5_K_S | 2.17 GB | |
| `mythos-nano-Q5_K_M.gguf` | Q5_K_M | 2.22 GB | high quality |
| `mythos-nano-Q6_K.gguf`   | Q6_K   | 2.54 GB | near-lossless |
| `mythos-nano-Q8_0.gguf`   | Q8_0   | 3.29 GB | ~lossless |
| `mythos-nano-f16.gguf`    | F16    | 6.18 GB | full precision |

## Usage
```bash
# llama.cpp
llama-cli -hf squ11z1/Mythos-nano-GGUF:Q4_K_M -p "Find all integer solutions of x^2 - y^2 = 12."
# Ollama
ollama run hf.co/squ11z1/Mythos-nano-GGUF:Q4_K_M
```
Recommended sampling: temperature **0.6–1.0**. This is a reasoning model — expect long
chain-of-thought before the final answer.

## License
MIT.