---
title: Recraft-v3-24-7-25_t2i_human_preference
canonical_url: "https://www.modelscope.cn/datasets/Rapidata/Recraft-v3-24-7-25_t2i_human_preference"
md_url: "https://www.modelscope.cn/datasets/Rapidata/Recraft-v3-24-7-25_t2i_human_preference.md"
repository: Rapidata/Recraft-v3-24-7-25_t2i_human_preference
last_updated: 2026-11-10
license: cdla-permissive-2.0
storage_size: "29 GB"
downloads: 184
stars: 0
---

# Recraft-v3-24-7-25_t2i_human_preference

> Recraft-v3-24-7-25_t2i_human_preference - Rapidata 在 ModelScope 开源的数据集。.vertical-container { display: flex; flex-direction: column; gap: 60px; } .horizontal-container { display: flex; flex-direction: row; justify-content: center; gap: 60px; }

Rapidata/Recraft-v3-24-7-25_t2i_human_preference 是 ModelScope 魔搭社区上的数据集，存储大小 29 GB，采用 cdla-permissive-2.0 许可。

- **Repository**: Rapidata/Recraft-v3-24-7-25_t2i_human_preference
- **License**: cdla-permissive-2.0
- **Storage size**: 29 GB
- **Downloads**: 184
- **Stars**: 0
- **Last updated**: 2026-11-10

Source: https://www.modelscope.cn/datasets/Rapidata/Recraft-v3-24-7-25_t2i_human_preference

---

<style>

.vertical-container {
    display: flex;  
    flex-direction: column;
    gap: 60px;  
}
  
.horizontal-container {
    display: flex;  
    flex-direction: row;
    justify-content: center;
    gap: 60px;  
}

.image-container img {
  max-height: 250px; /* Set the desired height */
  margin:0;
  object-fit: contain; /* Ensures the aspect ratio is maintained */
  width: auto; /* Adjust width automatically based on height */
  box-sizing: content-box;
}

.image-container img.big {
  max-height: 350px; /* Set the desired height */
}


.image-container {
  display: flex; /* Aligns images side by side */
  justify-content: space-around; /* Space them evenly */
  align-items: center; /* Align them vertically */
  gap: .5rem
}

  .container {
    width: 90%;
    margin: 0 auto;
  }

  .text-center {
    text-align: center;
  }

  .score-amount {
margin: 0;
margin-top: 10px;
  }

  .score-percentage {Score: 
    font-size: 12px;
    font-weight: semi-bold;
  }
  
</style>

# Rapidata Recraft v3 Preference

> **Size:** 65,931 rows · 462,043 individual human votes in total (verified against the parquet files on 2026-11-03)


<a href="https://rapidata.ai/?utm_source=huggingface&utm_medium=referral&utm_campaign=recraft_v3_24_7_25_t2i_human_preference&utm_content=dataset_card">
<img src="https://cdn-uploads.huggingface.co/production/uploads/66f5624c42b853e73e0738eb/jfxR79bOztqaC6_yNNnGU.jpeg" width="400" alt="Dataset visualization">
</a>

This T2I dataset contains over ~400'000 human responses from over ~50'000 individual annotators, collected in less than 7h using the [Rapidata Python API](https://docs.rapidata.ai/?utm_source=huggingface&utm_medium=referral&utm_campaign=recraft_v3_24_7_25_t2i_human_preference&utm_content=dataset_card), accessible to anyone and ideal for large scale evaluation.
Evaluating Recraft v3 (version from 24.7.2025) across three categories: preference, coherence, and alignment.

Explore our latest model rankings on our [website](https://www.benchmark.ai/image?utm_source=huggingface&utm_medium=referral&utm_campaign=recraft_v3_24_7_25_t2i_human_preference&utm_content=dataset_card).

If you get value from this dataset and would like to see more in the future, please consider liking it ❤️

To add your own model to the benchmark send us an e-mail at: jason@rapidata.ai

## Overview

The evaluation consists of 1v1 comparisons between Recraft v3 (version from 24.7.2025) and 18 other models: 
- 4o
- Flux-1-pro
- Flux-1.1-pro
- imagen 4 ultra
- Aurora
- Imagen-3
- DALL-E 3
- Midjourney-5.2
- Frames-23-1-25
- Stable Diffusion 3
- Janus-7b.
- hidream-l1-full
- Recraft V2
- Ideogram V2
- halfmoon-4-4-25
- Lumina-15-2-25
- Imagen 4 Ultra 20.5.25
- Imagen 4 Ultra 24.7.25

## Alignment

The alignment score quantifies how well an video matches its prompt. Users were asked: "Which image matches the description better?".

<div class="vertical-container">
  <div class="container">
   <div class="text-center">
      <q>A device consisting of a circular canopy of cloth on a folding metal frame supported by a central rod, used as protection against rain or sometimes sun.</q>
    </div>
    <div class="image-container">
      <div>
        <h3 class="score-amount">Recraft v3 </h3>
        <div class="score-percentage">Score: 100%</div>
        <img style="border: 5px solid #18c54f;" src="https://cdn-uploads.huggingface.co/production/uploads/672b7d79fd1e92e3c3567435/F4s5H4PiV_-dagyacaiFr.jpeg" width=500>
      </div>
      <div>
        <h3 class="score-amount">Janus 7b </h3>
        <div class="score-percentage">Score: 0%</div>
        <img src="https://cdn-uploads.huggingface.co/production/uploads/672b7d79fd1e92e3c3567435/tFGWSjlnS8W7w4yH9f71Q.jpeg" width=500>
      </div>
    </div>
  </div>

  <div class="container">
   <div class="text-center">
      <q>A brown toilet with a white wooden seat .</q>
    </div>
    <div class="image-container">
      <div>
        <h3 class="score-amount">Recraft v3 </h3>
        <div class="score-percentage">Score: 0%</div>
        <img  src="https://cdn-uploads.huggingface.co/production/uploads/672b7d79fd1e92e3c3567435/n00lh_XkDThrxrd2Nlr8g.jpeg" width=500>
      </div>
      <div>
        <h3 class="score-amount">Stable Diffusion 3 </h3>
        <div class="score-percentage">Score: 100%</div>
        <img style="border: 5px solid #18c54f;" src="https://cdn-uploads.huggingface.co/production/uploads/672b7d79fd1e92e3c3567435/rk2iBGCpVuCf2SWQoWDyR.jpeg" width=500>
      </div>
    </div>
  </div>
</div>

## Coherence

The coherence score measures whether the generated video is logically consistent and free from artifacts or visual glitches. Without seeing the original prompt, users were asked: "Which image has **more** glitches and is **more** likely to be AI generated?"

<div class="vertical-container">
  <div class="container">
    <div class="image-container">
      <div>
        <h3 class="score-amount">Recraft v3 </h3>
        <div class="score-percentage">Glitch Rating: 0%</div>
        <img style="border: 5px solid #18c54f;" src="https://cdn-uploads.huggingface.co/production/uploads/672b7d79fd1e92e3c3567435/CADQvkJBqne_sbfqm0MPF.jpeg" width=500>
      </div>
      <div>
        <h3 class="score-amount">Stable Diffusion 3 </h3>
        <div class="score-percentage">Glitch Rating: 100%</div>
        <img src="https://cdn-uploads.huggingface.co/production/uploads/672b7d79fd1e92e3c3567435/c7t-Nak8NGA-LAV4rlN0P.jpeg" width=500>
      </div>
    </div>
  </div>

   <div class="container">
    <div class="image-container">
      <div>
        <h3 class="score-amount">Recraft v3 </h3>
        <div class="score-percentage">Glitch Rating: 100%</div>
        <img src="https://cdn-uploads.huggingface.co/production/uploads/672b7d79fd1e92e3c3567435/zTf7fXlzQAySORzUiV0LJ.jpeg" width=500>
      </div>
      <div>
        <h3 class="score-amount">Imagen 3 </h3>
        <div class="score-percentage">Glitch Rating: 0%</div>
        <img style="border: 5px solid #18c54f;" src="https://cdn-uploads.huggingface.co/production/uploads/672b7d79fd1e92e3c3567435/49S2xgqyqgZjBtoc6eaGY.jpeg" width=500>
      </div>
    </div>
  </div>   
</div>

## Preference

The preference score reflects how visually appealing participants found each image, independent of the prompt. Users were asked: "Which image do you prefer?"

<div class="vertical-container">
  <div class="container">
    <div class="image-container">
      <div>
        <h3 class="score-amount">Recraft v3 </h3>
        <div class="score-percentage">Score: 100%</div>
        <img style="border: 5px solid #18c54f;" src="https://cdn-uploads.huggingface.co/production/uploads/672b7d79fd1e92e3c3567435/kB_ldhmftj7xf0R4RMQwE.jpeg" width=500>
      </div>
      <div>
        <h3 class="score-amount">Lumina-15-2-25</h3>
        <div class="score-percentage">Score: 0%</div>
        <img src="https://cdn-uploads.huggingface.co/production/uploads/672b7d79fd1e92e3c3567435/bisy3ru4WA8_KNC5cPHCB.jpeg" width=500>
      </div>
    </div>
  </div>

   <div class="container">
    <div class="image-container">
      <div>
        <h3 class="score-amount">Recraft v3 </h3>
        <div class="score-percentage">Score: 0%</div>
        <img  src="https://cdn-uploads.huggingface.co/production/uploads/672b7d79fd1e92e3c3567435/E9AB5ihYHE-0n2D2sp_2z.jpeg" width=500>
      </div>
      <div>
        <h3 class="score-amount">Flux 1 Pro </h3>
        <div class="score-percentage">Score: 100%</div>
        <img style="border: 5px solid #18c54f;" src="https://cdn-uploads.huggingface.co/production/uploads/672b7d79fd1e92e3c3567435/hisW7cK98yx5miz6FcwOg.jpeg" width=500>
      </div>
    </div>
  </div>
</div>

## About Rapidata

Rapidata's technology makes collecting human feedback at scale faster and more accessible than ever before. Visit [rapidata.ai](https://rapidata.ai/?utm_source=huggingface&utm_medium=referral&utm_campaign=recraft_v3_24_7_25_t2i_human_preference&utm_content=dataset_card) to learn more about how we're revolutionizing human feedback collection for AI development.
