---
title: granite-4.0-tiny-preview-GGUF
canonical_url: "https://www.modelscope.cn/models/AI-ModelScope/granite-4.0-tiny-preview-GGUF"
md_url: "https://www.modelscope.cn/models/AI-ModelScope/granite-4.0-tiny-preview-GGUF.md"
repository: AI-ModelScope/granite-4.0-tiny-preview-GGUF
last_updated: 2025-08-13
license: apache-2.0
pipeline_tag: text-generation
tasks:
  - text-generation
base_model:
  - ibm-granite/granite-4.0-tiny-base-preview
base_model_relation: quantized
library_name:
  - gguf
  - pytorch
frameworks:
  - pytorch
downloads: 123
stars: 0
tags:
  - language
  - granite-4.0
  - gguf
---

# granite-4.0-tiny-preview-GGUF

> granite-4.0-tiny-preview-GGUF - AI-ModelScope 在 ModelScope 开源的模型。[!NOTE] This repository contains models that have been converted to the GGUF format with various quantizations from an IBM Granite base model. Please reference the base model's full model card…

AI-ModelScope/granite-4.0-tiny-preview-GGUF 是 ModelScope 魔搭社区上的text-generation模型，采用 apache-2.0 许可，基于 ibm-granite/granite-4.0-tiny-base-preview 构建。

- **Repository**: AI-ModelScope/granite-4.0-tiny-preview-GGUF
- **License**: apache-2.0
- **Tasks**: text-generation
- **Base model**: ibm-granite/granite-4.0-tiny-base-preview
- **Tags**: language, granite-4.0, gguf
- **Downloads**: 123
- **Stars**: 0
- **Last updated**: 2025-08-13

Source: https://www.modelscope.cn/models/AI-ModelScope/granite-4.0-tiny-preview-GGUF

---

> [!NOTE]
> This repository contains models that have been converted to the GGUF format with various quantizations from an IBM Granite base model.
>
> Please reference the base model's full model card here:
> https://huggingface.co/ibm-granite/granite-4.0-tiny-preview

# Granite-4.0-Tiny-Preview

**Model Summary:**
Granite-4-Tiny-Preview is a 7B parameter fine-grained hybrid mixture-of-experts (MoE) instruct model fine-tuned from Granite-4.0-Tiny-Base-Preview using a combination of open source instruction datasets with permissive license and internally collected synthetic datasets tailored for solving long context problems. This model is developed using a diverse set of techniques with a structured chat format, including supervised fine-tuning, and model alignment using reinforcement learning.

- **Developers:** Granite Team, IBM
- **Website**: [Granite Docs](https://www.ibm.com/granite/docs/)
- **Release Date**: May 2nd, 2025
- **License:** [Apache 2.0](https://www.apache.org/licenses/LICENSE-2.0)

**Supported Languages:** 
English, German, Spanish, French, Japanese, Portuguese, Arabic, Czech, Italian, Korean, Dutch, and Chinese. However, users may fine-tune this Granite model for languages beyond these 12 languages.

**Intended Use:** 
This model is designed to handle general instruction-following tasks and can be integrated into AI assistants across various domains, including business applications.

**Capabilities**
* Thinking
* Summarization
* Text classification
* Text extraction
* Question-answering
* Retrieval Augmented Generation (RAG)
* Code related tasks
* Function-calling tasks
* Multilingual dialog use cases
* Long-context tasks including long document/meeting summarization, long document QA, etc.