---
title: Skywork-R1V2-38B-headless
canonical_url: "https://www.modelscope.cn/models/YanfeiSong/Skywork-R1V2-38B-headless"
md_url: "https://www.modelscope.cn/models/YanfeiSong/Skywork-R1V2-38B-headless.md"
repository: YanfeiSong/Skywork-R1V2-38B-headless
last_updated: 2025-04-25
license: mit
pipeline_tag: image-text-to-text
tasks:
  - image-text-to-text
model_type:
  - qwen2
architectures:
  - Qwen2ForCausalLM
base_model:
  - Skywork/Skywork-R1V2-38B
base_model_relation: repackage
parameters: 32.8B
tensor_type:
  - BF16
library_name:
  - safetensors
  - pytorch
frameworks:
  - PyTorch
language:
  - zh
inference_backends:
  - "deploy_task text/emb"
  - "lmdeploy 0.9.1"
  - "lmdeploy_turbomind 0.9.1"
  - "sglang 0.5.2"
  - "vllm 0.9.2"
downloads: 32
stars: 0
---

# Skywork-R1V2-38B-headless

> Skywork-R1V2-38B-headless - YanfeiSong 在 ModelScope 开源的模型。Skywork-R1V2的llm推理性能貌似不错, 就拆了llm模块下来给大家玩玩

YanfeiSong/Skywork-R1V2-38B-headless 是 ModelScope 魔搭社区上的 32.8B 参数image-text-to-text模型，采用 mit 许可，基于 Skywork/Skywork-R1V2-38B 构建，可用 deploy_task text/emb、lmdeploy 0.9.1、lmdeploy_turbomind 0.9.1 部署。

- **Repository**: YanfeiSong/Skywork-R1V2-38B-headless
- **License**: mit
- **Tasks**: image-text-to-text
- **Parameters**: 32.8B
- **Base model**: Skywork/Skywork-R1V2-38B
- **Inference backends**: deploy_task text/emb, lmdeploy 0.9.1, lmdeploy_turbomind 0.9.1, sglang 0.5.2, vllm 0.9.2
- **Downloads**: 32
- **Stars**: 0
- **Last updated**: 2025-04-25

Source: https://www.modelscope.cn/models/YanfeiSong/Skywork-R1V2-38B-headless

---

## 这个是不含视觉编码器的纯llm模块。
# 看Skywork-R1V2说他们的推理能力也很好， 因此拆下LLM模块来供大家研究，同时也方便优化部署, 使用vllm直接启动即可，要求与QwQ一致

---
## 📖 [R1V2 Report](https://github.com/SkyworkAI/Skywork-R1V/blob/main/Skywork_R1V2.pdf) | 💻 [GitHub](https://github.com/SkyworkAI/Skywork-R1V) | 🌐 [ModelScope](https://modelscope.cn/models/Skywork/Skywork-R1V-38B) | 📖 [R1V1 Report](https://github.com/SkyworkAI/Skywork-R1V/blob/main/Skywork_R1V.pdf)

<p align="center">
  <a href="https://github.com/SkyworkAI/Skywork-R1V/stargazers">
    <img src="https://img.shields.io/github/stars/SkyworkAI/Skywork-R1V" alt="GitHub Stars" />
  </a>
  <a href="https://github.com/SkyworkAI/Skywork-R1V/fork">
    <img src="https://img.shields.io/github/forks/SkyworkAI/Skywork-R1V" alt="GitHub Forks" />
  </a>
</p>



## 1. Model Introduction

Skywork-R1V2-38B is a **state-of-the-art open-source multimodal reasoning model**, achieving top-tier performance across multiple benchmarks:
- On **MMMU**, it scores **73.6%**, the **highest among all open-source models** to date.
- On **OlympiadBench**, it achieves **62.6%**, leading **by a large margin** over other open models.
- R1V2 also performs strongly on **MathVision**, **MMMU-Pro**, and **MathVista**, **rivaling proprietary commercial models**.
- Overall, R1V2 stands out as a **high-performing, open-source VLM** combining powerful **visual reasoning** and **text understanding**.

### 🔧 Model Details
<table>
  <thead>
    <tr>
      <th><strong>Model Name</strong></th>
      <th><strong>Vision Encoder</strong></th>
      <th><strong>Language Model</strong></th>
      <th><strong>Hugging Face Link</strong></th>
    </tr>
  </thead>
  <tbody>
    <tr>
      <td>Skywork-R1V2-38B</td>
      <td><a href="https://huggingface.co/OpenGVLab/InternViT-6B-448px-V2_5">InternViT-6B-448px-V2_5</a></td>
      <td><a href="https://huggingface.co/Qwen/QwQ-32B">Qwen/QwQ-32B</a></td>
      <td><a href="https://huggingface.co/Skywork/Skywork-R1V2-38B">🤗 Link</a></td>
    </tr>
  </tbody>
</table>


---

## 2. Evaluation


<style>
  section {
    margin-bottom: 4em;
  }
  figure {
    margin: 2em 0;
    text-align: center;
  }
  figcaption {
    font-weight: bold;
    margin-top: 0.5em;
  }
  table {
    margin: 3em auto;
    width: 100%;
    border-collapse: collapse;
  }
  table th, table td {
    padding: 0.6em;
    border: 1px solid #ddd;
    text-align: center;
  }
</style>

<section>
  <figure>
    <img src="open_source.png" alt="Open Source" width="100%" />
    <figcaption>Comparison with Larger-Scale Open-Source Models</figcaption>
  </figure>
</section>

<section>
  <figure>
    <img src="properitary.png" alt="Proprietary" width="100%" />
    <figcaption>Comparison with Proprietary Models</figcaption>
  </figure>
</section>

<section>
  <div align="center">
    <h3>Evaluation Results of State-of-the-Art LLMs and VLMs</h3>
  </div>
<table>
  <thead>
    <tr>
      <th>Model</th>
      <th align="center"><strong>Supports Vision</strong></th>
      <th align="center" colspan="8"><strong>Text Reasoning (%)</strong></th>
      <th align="center" colspan="5"><strong>Multimodal Reasoning (%)</strong></th>
    </tr>
    <tr>
      <th></th>
      <th></th>
      <th align="center">AIME24</th>
      <th align="center">LiveCodebench</th>
      <th align="center">liveBench</th>
      <th align="center">IFEVAL</th>
      <th align="center">BFCL</th>
      <th align="center">MATH‑500</th>
      <th align="center">AIME 2024</th>
      <th align="center">GPQA</th>
      <th align="center">MMMU(val)</th>
      <th align="center">MathVista(mini)</th>
      <th align="center">MathVision(mini)</th>
      <th align="center">OlympiadBench</th>
      <th align="center">mmmu‑pro</th>
    </tr>
    <tr>
      <th></th>
      <th></th>
      <th align="center">%</th>
      <th align="center">%</th>
      <th align="center">%</th>
      <th align="center">%</th>
      <th align="center">%</th>
      <th align="center">pass@1</th>
      <th align="center">pass@1</th>
      <th align="center">pass@1</th>
      <th align="center">%</th>
      <th align="center">%</th>
      <th align="center">%</th>
      <th align="center">%</th>
      <th align="center">%</th>
    </tr>
  </thead>
  <tbody>
    <tr>
      <td>R1V2‑38B</td>
      <td align="center">✅</td>
      <td align="center">78.9</td>
      <td align="center">63.6</td>
      <td align="center">73.2</td>
      <td align="center">82.9</td>
      <td align="center">66.3</td>
      <td align="center">94.0</td>
      <td align="center">72.0</td>
      <td align="center">61.6</td>
      <td align="center">73.6</td>
      <td align="center">74.0</td>
      <td align="center">49.0</td>
      <td align="center">62.6</td>
      <td align="center">52.0</td>
    </tr>
    <tr>
      <td>R1V1‑38B</td>
      <td align="center">✅</td>
      <td align="center">72.0</td>
      <td align="center">57.2</td>
      <td align="center">54.6</td>
      <td align="center">72.5</td>
      <td align="center">53.5</td>
      <td align="center">–</td>
      <td align="center">–</td>
      <td align="center">–</td>
      <td align="center">68.0</td>
      <td align="center">67.0</td>
      <td align="center">–</td>
      <td align="center">40.4</td>
      <td align="center">–</td>
    </tr>
    <tr>
      <td>Deepseek‑R1‑671B</td>
      <td align="center">❌</td>
      <td align="center">74.3</td>
      <td align="center">65.9</td>
      <td align="center">71.6</td>
      <td align="center">83.3</td>
      <td align="center">60.3</td>
      <td align="center">97.3</td>
      <td align="center">79.8</td>
      <td align="center">71.5</td>
      <td align="center">–</td>
      <td align="center">–</td>
      <td align="center">–</td>
      <td align="center">–</td>
      <td align="center">–</td>
    </tr>
    <tr>
      <td>GPT‑o1</td>
      <td align="center">❌</td>
      <td align="center">79.8</td>
      <td align="center">63.4</td>
      <td align="center">72.2</td>
      <td align="center">–</td>
      <td align="center">–</td>
      <td align="center">–</td>
      <td align="center">–</td>
      <td align="center">–</td>
      <td align="center">–</td>
      <td align="center">–</td>
      <td align="center">–</td>
      <td align="center">–</td>
      <td align="center">–</td>
    </tr>
    <tr>
      <td>GPT‑o4‑mini</td>
      <td align="center">✅</td>
      <td align="center">93.4</td>
      <td align="center">74.6</td>
      <td align="center">78.1</td>
      <td align="center">–</td>
      <td align="center">–</td>
      <td align="center">74.6</td>
      <td align="center">9.3</td>
      <td align="center">49.9</td>
      <td align="center">81.6</td>
      <td align="center">84.3</td>
      <td align="center">58.0</td>
      <td align="center">–</td>
      <td align="center">–</td>
    </tr>
    <tr>
      <td>Claude 3.5 Sonnet</td>
      <td align="center">✅</td>
      <td align="center">–</td>
      <td align="center">–</td>
      <td align="center">–</td>
      <td align="center">–</td>
      <td align="center">–</td>
      <td align="center">78.3</td>
      <td align="center">16.0</td>
      <td align="center">65.0</td>
      <td align="center">66.4</td>
      <td align="center">65.3</td>
      <td align="center">–</td>
      <td align="center">–</td>
      <td align="center">–</td>
    </tr>
    <tr>
      <td>Kimi k1.5 long-cot</td>
      <td align="center">✅</td>
      <td align="center">–</td>
      <td align="center">–</td>
      <td align="center">–</td>
      <td align="center">–</td>
      <td align="center">–</td>
      <td align="center">96.2</td>
      <td align="center">77.5</td>
      <td align="center">–</td>
      <td align="center">70.0</td>
      <td align="center">74.9</td>
      <td align="center">–</td>
      <td align="center">–</td>
      <td align="center">–</td>
    </tr>
    <tr>
      <td>Qwen2.5‑VL‑72B‑Instruct</td>
      <td align="center">✅</td>
      <td align="center">–</td>
      <td align="center">–</td>
      <td align="center">–</td>
      <td align="center">–</td>
      <td align="center">–</td>
      <td align="center">–</td>
      <td align="center">–</td>
      <td align="center">–</td>
      <td align="center">70.2</td>
      <td align="center">74.8</td>
      <td align="center">–</td>
      <td align="center">–</td>
      <td align="center">–</td>
    </tr>
    <tr>
      <td>InternVL2.5‑78B</td>
      <td align="center">✅</td>
      <td align="center">–</td>
      <td align="center">–</td>
      <td align="center">–</td>
      <td align="center">–</td>
      <td align="center">–</td>
      <td align="center">–</td>
      <td align="center">–</td>
      <td align="center">–</td>
      <td align="center">70.1</td>
      <td align="center">72.3</td>
      <td align="center">–</td>
      <td align="center">33.2</td>
      <td align="center">–</td>
    </tr>
  </tbody>
</table>
</section>




---


## 3. Usage

### 1. Clone the Repository

```shell
git clone https://github.com/SkyworkAI/Skywork-R1V.git
cd skywork-r1v/inference
```
### 2. Set Up the Environment

```shell
conda create -n r1v-vllm python=3.12
conda activate r1v-vllm
pip install -U vllm
```

### 3. Run the Inference Script
transformers inference

```shell
CUDA_VISIBLE_DEVICES="0,1" python inference_with_transformers.py \
    --model_path path \
    --image_paths image1_path \
    --question "your question"
```

vllm inference
```shell
python inference_with_vllm.py \
    --model_path path \
    --image_paths image1_path image2_path \
    --question "your question" \
    --tensor_parallel_size 4
```

---

## 4. Citation
If you use Skywork-R1V in your research, please cite:

```
@misc{chris2025skyworkr1v2,
    title        = {Skywork R1V2: Visual Hybrid Reinforcement Learning for Multimodal Reasoning},
    author       = {Chris and Yichen Wei and Yi Peng and Xiaokun Wang and Weijie Qiu and Wei Shen and Tianyidan Xie and Jiangbo Pei and Jianhao Zhang and Yunzhuo Hao and Xuchen Song and Yang Liu and Yahui Zhou},
    year         = {2025},
    institution  = {Skywork AI, Kunlun Inc.},
    howpublished = {\url{https://github.com/SkyworkAI/Skywork-R1V/blob/main/Skywork_R1V2.pdf}},
}
```

```
@misc{peng2025skyworkr1vpioneeringmultimodal,
      title={Skywork R1V: Pioneering Multimodal Reasoning with Chain-of-Thought}, 
      author={Yi Peng and Chris and Xiaokun Wang and Yichen Wei and Jiangbo Pei and Weijie Qiu and Ai Jian and Yunzhuo Hao and Jiachun Pan and Tianyidan Xie and Li Ge and Rongxian Zhuang and Xuchen Song and Yang Liu and Yahui Zhou},
      year={2025},
      eprint={2504.05599},
      archivePrefix={arXiv},
      primaryClass={cs.CV},
      url={https://arxiv.org/abs/2504.05599}, 
}
```

*This project is released under an open-source license.*
