---
title: LLaDA2.0-Uni-FP8
canonical_url: "https://www.modelscope.cn/models/inclusionAI/LLaDA2.0-Uni-FP8"
md_url: "https://www.modelscope.cn/models/inclusionAI/LLaDA2.0-Uni-FP8.md"
repository: inclusionAI/LLaDA2.0-Uni-FP8
last_updated: 2026-05-27
license: apache-2.0
pipeline_tag: any-to-any
tasks:
  - any-to-any
model_type:
  - llada2_moe
architectures:
  - LLaDA2MoeModelLM
base_model:
  - inclusionAI/LLaDA2.0-Uni
base_model_relation: finetune
parameters: 16.3B
tensor_type:
  - BF16
  - F8_E4M3
library_name:
  - transformer
  - lora
  - safetensors
  - diffusers
  - pytorch
frameworks:
  - Pytorch
language:
  - en
downloads: 135
stars: 1
tags:
  - multimodal
  - image-generation
  - image-understanding
  - image-editing
  - diffusion
  - moe
  - text-to-image
  - fp8
  - quantized
---

# LLaDA2.0-Uni-FP8

> LLaDA2.0-Uni-FP8 - inclusionAI 在 ModelScope 开源的模型。LLaDA2.0-Uni: Unifying Multimodal Understanding and Generation with Diffusion Large Language Model FP8 Quantized Version of LLaDA2.0-Uni

inclusionAI/LLaDA2.0-Uni-FP8 是 ModelScope 魔搭社区上的 16.3B 参数any-to-any模型，采用 apache-2.0 许可，基于 inclusionAI/LLaDA2.0-Uni 构建。

- **Repository**: inclusionAI/LLaDA2.0-Uni-FP8
- **License**: apache-2.0
- **Tasks**: any-to-any
- **Parameters**: 16.3B
- **Base model**: inclusionAI/LLaDA2.0-Uni
- **Tags**: multimodal, image-generation, image-understanding, image-editing, diffusion, moe, text-to-image, fp8, quantized
- **Downloads**: 135
- **Stars**: 1
- **Last updated**: 2026-05-27

Source: https://www.modelscope.cn/models/inclusionAI/LLaDA2.0-Uni-FP8

---

<p align="center">
 <img src="./assets/llada_logo.png" width="20%"/>
</p>
<div align="center">
 <h1> LLaDA2.0-Uni: Unifying Multimodal Understanding and Generation with Diffusion Large Language Model </h1>
 <h3> FP8 Quantized Version of LLaDA2.0-Uni </h3>

  [[📑 Technical Report]()] &emsp; [[🌐 Github](https://github.com/inclusionAI/LLaDA2.0-Uni)]

 <b>AGI Research Center, Inclusion AI</b>
</div>

## Overview

This is the **FP8 quantized** version of [LLaDA2.0-Uni](https://huggingface.co/inclusionAI/LLaDA2.0-Uni), featuring block-wise FP8 quantization of MoE expert weights. This reduces GPU memory usage by ~48% for model loading while preserving output quality.

### Quantization Details

- **Method**: Block-wise FP8 (float8_e4m3fn) with per-block scale factors
- **Block size**: 128×128
- **Quantized layers**: MoE routed expert weights (gate_proj, up_proj, down_proj)
- **Kept in BF16**: Embeddings, lm_head, attention projections, shared experts, layer norms, routing gates

### Memory Comparison

| Variant | Model Loading | T2I Peak | Understanding Peak | Edit Peak |
|---------|--------------|----------|-------------------|-----------|
| BF16    | 62.9 GB      | 35.3 GB  | 33.2 GB           | 41.7 GB   |
| FP8     | 32.5 GB      | 35.3 GB  | 33.3 GB           | 41.8 GB   |

> **Note**: FP8 halves the static model weight memory (~30 GB saved at load time). Peak inference memory is similar because activations dominate during generation.

## Quick Start

```python
from transformers import AutoModelForCausalLM, AutoTokenizer

model_path = "inclusionAI/LLaDA2.0-Uni-FP8"

tokenizer = AutoTokenizer.from_pretrained(model_path, trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained(
    model_path, device_map="cuda", trust_remote_code=True
).eval()
model.tokenizer = tokenizer

# Text-to-Image Generation
result = model.generate_image(
    "A cat sitting on a windowsill at sunset",
    image_h=1024, image_w=1024,
    steps=16, cfg_scale=4.0,
)

# Decode VQ tokens to image
from decoder import decode_vq_tokens
image = decode_vq_tokens(
    result["token_ids"], result["h"], result["w"],
    model_path, "cuda",
    num_steps=8, decode_mode="decoder-turbo",
)
image.save("output.png")
```

## Model Capabilities

Same as the base LLaDA2.0-Uni model:

- 🖼️ **Text-to-Image Generation**
- 🔍 **Image Understanding**
- ✏️ **Image Editing**
- ⚡ **Sprint Acceleration**


## ⚠️ License

This project is licensed under the terms of the [Apache License 2.0](https://www.apache.org/licenses/LICENSE-2.0).

## 📖 BibTeX

```bibtex
@article{LLaDA2Uni,
title = {LLaDA2.0-Uni: Unifying Multimodal Understanding and Generation with Diffusion Large Language Model},
author = {Tiwei Bie and Haoxing Chen and Tieyuan Chen and Zhenglin Cheng and Long Cui and Kai Gan and Zhicheng Huang and Zhenzhong Lan and Haoquan Li and Jianguo Li and Tao Lin and Qi Qin and Hongjun Wang and Xiaomei Wang and Haoyuan Wu and Yi Xin and Junbo Zhao},
journal = {arXiv preprint arXiv:2604.20796},
year = {2026}
}