---
title: SRPO-Refine-Quantized
canonical_url: "https://www.modelscope.cn/models/wikeeyang/SRPO-Refine-Quantized"
md_url: "https://www.modelscope.cn/models/wikeeyang/SRPO-Refine-Quantized.md"
repository: wikeeyang/SRPO-Refine-Quantized
chinese_name: SRPO-Refine-Quantized-v1.0
last_updated: 2025-09-24
license: other
pipeline_tag: text-to-image-synthesis
tasks:
  - text-to-image-synthesis
base_model:
  - tencent/SRPO
base_model_relation: quantized
parameters: 23.8B
tensor_type:
  - BF16
  - F8_E4M3
library_name:
  - safetensors
  - gguf
  - pytorch
frameworks:
  - PyTorch
language:
  - en
downloads: 697
stars: 7
tags:
  - gguf
---

# SRPO-Refine-Quantized

> SRPO-Refine-Quantized - wikeeyang 在 ModelScope 开源的模型。===================================================================================

wikeeyang/SRPO-Refine-Quantized 是 ModelScope 魔搭社区上的 23.8B 参数text-to-image-synthesis模型，采用 other 许可，基于 tencent/SRPO 构建。

- **Repository**: wikeeyang/SRPO-Refine-Quantized
- **License**: other
- **Tasks**: text-to-image-synthesis
- **Parameters**: 23.8B
- **Base model**: tencent/SRPO
- **Tags**: gguf
- **Downloads**: 697
- **Stars**: 7
- **Last updated**: 2025-09-24

Source: https://www.modelscope.cn/models/wikeeyang/SRPO-Refine-Quantized

---

===================================================================================

# SRPO-Refine-Quantized-v1.0

本模型为 https://www.modelscope.cn/models/tencent-community/SRPO 模型的 精调 和 8bit/4bit (fp8_e4m3fn/Q8_0/Q4_1) 量化版本，主要提升出图的清晰度和模型的兼容性。

This model is the refine and quantized version of the model: https://www.modelscope.cn/models/tencent-community/SRPO, it improve the clarity of the generated images and the compatibility of the models.

<p align="center">
    <img src="Compare.jpg" width="1200"/>
<p>

## Example workflow: Please refer to workflow.png

Also on: https://huggingface.co/wikeeyang/SRPO-Refine-Quantized-v1.0; https://civitai.com/models/1953067

## License Agreement

Please fall under SRPO license refer license.txt file and refer to the FLUX.1 [dev] Non-Commercial License. 


以下部分引用自原模型说明内容：

===================================================================================


<div align=“center” style=“font-family: charter;”>
<h1 align="center">Directly Aligning the Full Diffusion Trajectory with Fine-Grained Human Preference </h1>
<div align="center">
  <a href='https://arxiv.org/abs/2509.06942'><img src='https://img.shields.io/badge/ArXiv-red?logo=arxiv'></a>  &nbsp;
  <a href='https://github.com/Tencent-Hunyuan/SRPO'><img src='https://img.shields.io/badge/_Code-SRPO-181717?color=121717&logo=github&logoColor=whitee'></a> &nbsp; 
  <a href='https://tencent.github.io/srpo-project-page/'><img src='https://img.shields.io/badge/%F0%9F%92%BB_Project-SRPO-blue'></a> &nbsp;
</div>
<div align="center">
  Xiangwei Shen<sup>1,2*</sup>,
  <a href="https://scholar.google.com/citations?user=Lnr1FQEAAAAJ&hl=zh-CN" target="_blank"><b>Zhimin Li</b></a><sup>1*</sup>,
  <a href="https://scholar.google.com.hk/citations?user=Fz3X5FwAAAAJ" target="_blank"><b>Zhantao Yang</b></a><sup>1</sup>, 
  <a href="https://shiyi-zh0408.github.io/" target="_blank"><b>Shiyi Zhang</b></a><sup>3</sup>,
  Yingfang Zhang<sup>1</sup>,
  Donghao Li<sup>1</sup>,
  <br>
  <a href="https://scholar.google.com/citations?user=VXQV5xwAAAAJ&hl=en" target="_blank"><b>Chunyu Wang</b></a><sup>1</sup>,
  <a href="https://openreview.net/profile?id=%7EQinglin_Lu2" target="_blank"><b>Qinglin Lu</b></a><sup>1</sup>,
  <a href="https://andytang15.github.io" target="_blank"><b>Yansong Tang</b></a><sup>3,✝</sup>
</div>
<div align="center">
  <sup>1</sup>Hunyuan, Tencent 
  <br>
  <sup>2</sup>School of Science and Engineering, The Chinese University of Hong Kong, Shenzhen 
  <br>
  <sup>3</sup>Shenzhen International Graduate School, Tsinghua University 
  <br>
  <sup>*</sup>Equal contribution 
  <sup>✝</sup>Corresponding author
</div>



## Abstract
Recent studies have demonstrated the effectiveness of directly aligning diffusion models with human preferences using differentiable reward. However, they exhibit two primary challenges: (1) they rely on multistep denoising with gradient computation for reward scoring, which is computationally expensive, thus restricting optimization to only a few diffusion steps; (2) they often need continuous offline adaptation of reward models in order to achieve desired aesthetic quality, such as photorealism or precise lighting effects. To address the limitation of multistep denoising, we propose Direct-Align, a method that predefines a noise prior to effectively recover original images from any time steps via interpolation, leveraging the equation that diffusion states are interpolations between noise and target images, which effectively avoids over-optimization in late timesteps. Furthermore, we introduce Semantic Relative Preference Optimization (SRPO), in which rewards are formulated as text-conditioned signals. This approach enables online adjustment of rewards in response to positive and negative prompt augmentation, thereby reducing the reliance on offline reward fine-tuning. By fine-tuning the FLUX.1.dev model with optimized denoising and online reward adjustment, we improve its human-evaluated realism and aesthetic quality by over 3x.
### Checkpoints
The `diffusion_pytorch_model.safetensors` is online version of SRPO based on [FLUX.1 Dev](https://huggingface.co/black-forest-labs/FLUX.1-dev), trained on HPD dataset with [HPSv2](https://github.com/tgxs002/HPSv2)

### License
SRPO is licensed under the License Terms of SRPO. See `./License.txt` for more details.
## Citation
If you use SRPO for your research, please cite our paper:

```bibtex
@misc{shen2025directlyaligningdiffusiontrajectory,
      title={Directly Aligning the Full Diffusion Trajectory with Fine-Grained Human Preference}, 
      author={Xiangwei Shen and Zhimin Li and Zhantao Yang and Shiyi Zhang and Yingfang Zhang and Donghao Li and Chunyu Wang and Qinglin Lu and Yansong Tang},
      year={2025},
      eprint={2509.06942},
      archivePrefix={arXiv},
      primaryClass={cs.AI},
      url={https://arxiv.org/abs/2509.06942}, 
}
```
