---
title: MOSS-Image-SFT-8-steps-dmd
canonical_url: "https://www.modelscope.cn/models/lodestones/MOSS-Image-SFT-8-steps-dmd"
md_url: "https://www.modelscope.cn/models/lodestones/MOSS-Image-SFT-8-steps-dmd.md"
repository: lodestones/MOSS-Image-SFT-8-steps-dmd
last_updated: 2026-10-17
license: apache-2.0
base_model:
  - OpenMOSS-Team/MOSS-Image-SFT
base_model_relation: finetune
parameters: 5.7B
tensor_type:
  - F32
library_name:
  - safetensors
  - pytorch
frameworks:
  - pytorch
downloads: 876
stars: 2
---

# MOSS-Image-SFT-8-steps-dmd

> MOSS-Image-SFT-8-steps-dmd - lodestones 在 ModelScope 开源的模型。Demo https://huggingface.co/spaces/hugging-apps/moss-image-8-step-dmd

lodestones/MOSS-Image-SFT-8-steps-dmd 是 ModelScope 魔搭社区上的 5.7B 参数机器学习模型，采用 apache-2.0 许可，基于 OpenMOSS-Team/MOSS-Image-SFT 构建。

- **Repository**: lodestones/MOSS-Image-SFT-8-steps-dmd
- **License**: apache-2.0
- **Parameters**: 5.7B
- **Base model**: OpenMOSS-Team/MOSS-Image-SFT
- **Downloads**: 876
- **Stars**: 2
- **Last updated**: 2026-10-17

Source: https://www.modelscope.cn/models/lodestones/MOSS-Image-SFT-8-steps-dmd

---

# Demo
https://huggingface.co/spaces/hugging-apps/moss-image-8-step-dmd

# MOSS-Image-SFT, 8-step data-space DMD
Work-in-progress distillation of [OpenMOSS-Team/MOSS-Image-SFT](https://huggingface.co/OpenMOSS-Team/MOSS-Image-SFT)
(50 steps, CFG 3) to 8 network evaluations, no CFG. Data-space DMD (arXiv 2610.12102): the
generator iterates on its own clean estimate from fixed noise. Trained on compact-JSON `scene_graph` captions.

Checkpoint: update 2600 (EMA), float32 weights.

# Usage
load [lora.safetensors](https://huggingface.co/lodestones/MOSS-Image-SFT-8-steps-dmd/resolve/main/lora.safetensors) (at 1 strength recommended) or [lora_latest.safetensors](https://huggingface.co/lodestones/MOSS-Image-SFT-8-steps-dmd/resolve/main/lora_latest.safetensors) (at 0.7 strength recommended) directly to your comfyui lora loader

# [Deprecated] ignore this section
`transformer/` is a stock `MOSSImageTransformer` (load it with the release `pipeline_moss_image.py`); the
text encoder, tokenizer and VAE are the base repo's.

Precision: the distillation delta is smaller than bf16's rounding step, so `transformer/` must be loaded AND run
in fp32 (`torch_dtype=torch.float32`, no autocast); casting it to bf16 discards most of the distillation. For fast
bf16 inference keep the base repo's bf16 transformer and apply the adapter files unmerged:

- `lora.safetensors`: fp32 LoRA, rank 128 / alpha 128 on every block's `proj.{q,k,v,o,ffn_up_gate,ffn_down}`,
  kohya keys `diffusion_model.<module>.lora_down.weight` / `lora_up.weight` / `alpha`; apply as
  `y = W x + (alpha / rank) * up(down(x))`.
- `time_embedding.safetensors`: fp32 replacements for `time_embedding.*` (the step embedder) AND
  `shared_block_modulation.bias` / `video_head_modulation.bias`; the t=1 time vector is folded into those biases,
  so the embedder only works together with them. Keep these three modules in fp32.
- `generator.safetensors`: the same tensors in one file (`<module>.lora_A/B` keys) plus Q and the step codes.

The sampler differs from the release scheduler:

```python
from safetensors.torch import load_file
ds = load_file("dataspace.safetensors")            # latent_mix.Q [128, 128], step_codes [8]
Q, codes = ds["latent_mix.Q"].cuda(), ds["step_codes"].cuda()
z = torch.randn(1, 128, H // 16, W // 16, device="cuda")   # fp32
x0 = torch.zeros_like(z)
for r in range(8):                            # fewer steps also work (each prefix is trained)
    x = z + torch.einsum("oc,bchw->bohw", Q, x0)
    v = transformer(x, codes[r], prompt_embeds, prompt_mask).sample.float()
    x0 = z - v
# decode x0 with the release VAE (BN denormalize + 2x2 unpatchify)
```