---
title: Recraft-V2_t2i_human_preference
canonical_url: "https://www.modelscope.cn/datasets/Rapidata/Recraft-V2_t2i_human_preference"
md_url: "https://www.modelscope.cn/datasets/Rapidata/Recraft-V2_t2i_human_preference.md"
repository: Rapidata/Recraft-V2_t2i_human_preference
last_updated: 2025-04-22
license: "Apache License 2.0"
storage_size: "4.8 GB"
downloads: 836
stars: 0
---

# Recraft-V2_t2i_human_preference

> Recraft-V2_t2i_human_preference - Rapidata 在 ModelScope 开源的数据集。.vertical-container { display: flex; flex-direction: column; gap: 60px; }

Rapidata/Recraft-V2_t2i_human_preference 是 ModelScope 魔搭社区上的数据集，存储大小 4.8 GB，采用 Apache License 2.0 许可。

- **Repository**: Rapidata/Recraft-V2_t2i_human_preference
- **License**: Apache License 2.0
- **Storage size**: 4.8 GB
- **Downloads**: 836
- **Stars**: 0
- **Last updated**: 2025-04-22

Source: https://www.modelscope.cn/datasets/Rapidata/Recraft-V2_t2i_human_preference

---

<style>

.vertical-container {
    display: flex;  
    flex-direction: column;
    gap: 60px;  
}

.image-container img {
  max-height: 250px; /* Set the desired height */
  margin:0;
  object-fit: contain; /* Ensures the aspect ratio is maintained */
  width: auto; /* Adjust width automatically based on height */
  box-sizing: content-box;
}

.image-container {
  display: flex; /* Aligns images side by side */
  justify-content: space-around; /* Space them evenly */
  align-items: center; /* Align them vertically */
  gap: .5rem
}

  .container {
    width: 90%;
    margin: 0 auto;
  }

  .text-center {
    text-align: center;
  }

  .score-amount {
margin: 0;
margin-top: 10px;
  }

  .score-percentage {Score: 
    font-size: 12px;
    font-weight: semi-bold;
  }
  
</style>

# Rapidata Recraft-V2 Preference

<a href="https://www.rapidata.ai">
<img src="https://cdn-uploads.huggingface.co/production/uploads/66f5624c42b853e73e0738eb/jfxR79bOztqaC6_yNNnGU.jpeg" width="400" alt="Dataset visualization">
</a>

This T2I dataset contains over 195k human responses from over 47k individual annotators, collected in just ~1 Day using the [Rapidata Python API](https://docs.rapidata.ai), accessible to anyone and ideal for large scale evaluation.
Evaluating Recraft-V2 across three categories: preference, coherence, and alignment.

Explore our latest model rankings on our [website](https://www.rapidata.ai/benchmark).

If you get value from this dataset and would like to see more in the future, please consider liking it.

## Overview

This T2I dataset contains over 195k human responses from over 47k individual annotators, collected in just ~1 Day.
Evaluating Recraft-V2 across three categories: preference, coherence, and alignment.

The evaluation consists of 1v1 comparisons between Recraft V2 and 10 other models: Lumina-15-2-25, Imagen-3, Flux-1.1-pro, Flux-1-pro, DALL-E 3, Midjourney-5.2, Stable Diffusion 3, Aurora and Janus-7b.

## Alignment

The alignment score quantifies how well an video matches its prompt. Users were asked: "Which image matches the description better?".

<div class="vertical-container">
  <div class="container">
   <div class="text-center">
      <q>A person and a airplane, the person is bigger than the airplane.</q>
    </div>
    <div class="image-container">
      <div>
        <h3 class="score-amount">Recraft V2 </h3>
        <div class="score-percentage">Score: 91.6%</div>
        <img style="border: 3px solid #18c54f;" src="https://cdn-uploads.huggingface.co/production/uploads/664dcc6296d813a7e15e170e/ErVTBXcjUxhb50NhBWp6H.jpeg" width=500>
      </div>
      <div>
        <h3 class="score-amount">Flux-1.1 Pro </h3>
        <div class="score-percentage">Score: 8.4%</div>
        <img src="https://cdn-uploads.huggingface.co/production/uploads/664dcc6296d813a7e15e170e/LO46J3T16njt3pbFlOdPc.jpeg" width=500>
      </div>
    </div>
  </div>

  <div class="container">
   <div class="text-center">
      <q>Four dogs on the street.</q>
    </div>
    <div class="image-container">
      <div>
        <h3 class="score-amount">Recraft V2</h3>
        <div class="score-percentage">Score: 0%</div>
        <img  src="https://cdn-uploads.huggingface.co/production/uploads/664dcc6296d813a7e15e170e/YEmXF0lUrwLnRWlIRfnKW.jpeg" width=500>
      </div>
      <div>
        <h3 class="score-amount">Lumina-15-2-25</h3>
        <div class="score-percentage">Score: 100%</div>
        <img style="border: 3px solid #18c54f;" src="https://cdn-uploads.huggingface.co/production/uploads/664dcc6296d813a7e15e170e/KuE1LS4yJRcSkZigstF_i.jpeg" width=500>
      </div>
    </div>
  </div>
</div>

## Coherence

The coherence score measures whether the generated video is logically consistent and free from artifacts or visual glitches. Without seeing the original prompt, users were asked: "Which image has **more** glitches and is **more** likely to be AI generated?"

<div class="vertical-container">
  <div class="container">
    <div class="image-container">
      <div>
        <h3 class="score-amount">Recraft V2 </h3>
        <div class="score-percentage">Glitch Rating: 0%</div>
        <img style="border: 3px solid #18c54f;" src="https://cdn-uploads.huggingface.co/production/uploads/664dcc6296d813a7e15e170e/xW1D3Z02doO8Fjtf95GgW.jpeg" width=500>
      </div>
      <div>
        <h3 class="score-amount">Janus-7B </h3>
        <div class="score-percentage">Glitch Rating: 100%</div>
        <img src="https://cdn-uploads.huggingface.co/production/uploads/664dcc6296d813a7e15e170e/_pD7I7Ytg612EdjY0Ccqg.jpeg" width=500>
      </div>
    </div>
  </div>

   <div class="container">
    <div class="image-container">
      <div>
        <h3 class="score-amount">Recraft V2 </h3>
        <div class="score-percentage">Glitch Rating: 90.2%</div>
        <img src="https://cdn-uploads.huggingface.co/production/uploads/664dcc6296d813a7e15e170e/bnDvn3RH1kSA4wsu2tW-H.jpeg" width=500>
      </div>
      <div>
        <h3 class="score-amount">Frames-23-1-25</h3>
        <div class="score-percentage">Glitch Rating: 9.8%</div>
        <img style="border: 3px solid #18c54f;" src="https://cdn-uploads.huggingface.co/production/uploads/664dcc6296d813a7e15e170e/tOIQ3BGH3ak7VGypR4ERo.jpeg" width=500>
      </div>
    </div>
  </div>   
</div>

## Preference

The preference score reflects how visually appealing participants found each image, independent of the prompt. Users were asked: "Which image do you prefer?"

<div class="vertical-container">
  <div class="container">
    <div class="image-container">
      <div>
        <h3 class="score-amount">Recraft V2</h3>
        <div class="score-percentage">Score: 100%</div>
        <img style="border: 3px solid #18c54f;" src="https://cdn-uploads.huggingface.co/production/uploads/664dcc6296d813a7e15e170e/tFyjXMgsohsNXYmkz74jW.jpeg" width=500>
      </div>
      <div>
        <h3 class="score-amount">Lumina-15-2-25</h3>
        <div class="score-percentage">Score: 0%</div>
        <img src="https://cdn-uploads.huggingface.co/production/uploads/664dcc6296d813a7e15e170e/DgtW_5bk-Q1p_KsZIHaOE.jpeg" width=500>
      </div>
    </div>
  </div>

   <div class="container">
    <div class="image-container">
      <div>
        <h3 class="score-amount">Recraft V2 </h3>
        <div class="score-percentage">Score: 0%</div>
        <img  src="https://cdn-uploads.huggingface.co/production/uploads/664dcc6296d813a7e15e170e/0kv207jq2I0ZAe5zkcOCq.jpeg" width=500>
      </div>
      <div>
        <h3 class="score-amount">Frames-23-1-25 </h3>
        <div class="score-percentage">Score: 100%</div>
        <img style="border: 3px solid #18c54f;" src="https://cdn-uploads.huggingface.co/production/uploads/664dcc6296d813a7e15e170e/KUC7bX--M7Hx8BTO4Ns0c.jpeg" width=500>
      </div>
    </div>
  </div>
</div>

## About Rapidata

Rapidata's technology makes collecting human feedback at scale faster and more accessible than ever before. Visit [rapidata.ai](https://www.rapidata.ai/) to learn more about how we're revolutionizing human feedback collection for AI development.