---
title: SKYLENAGE-GameCodeGym
canonical_url: "https://www.modelscope.cn/datasets/Alibaba-DT/SKYLENAGE-GameCodeGym"
md_url: "https://www.modelscope.cn/datasets/Alibaba-DT/SKYLENAGE-GameCodeGym.md"
repository: Alibaba-DT/SKYLENAGE-GameCodeGym
last_updated: 2025-09-25
license: "Apache License 2.0"
storage_size: "24 MB"
downloads: 346
stars: 7
---

# SKYLENAGE-GameCodeGym

> SKYLENAGE-GameCodeGym - Alibaba-DT 在 ModelScope 开源的数据集。I. Benchmark Introduction SKYLENAGE-GameCodeGym (V-GameGym) is a comprehensive benchmark for code LLMs, addressing the lack of evaluation in visual game development. It includes 2,219 samples across 100…

Alibaba-DT/SKYLENAGE-GameCodeGym 是 ModelScope 魔搭社区上的数据集，存储大小 24 MB，采用 Apache License 2.0 许可。

- **Repository**: Alibaba-DT/SKYLENAGE-GameCodeGym
- **License**: Apache License 2.0
- **Storage size**: 24 MB
- **Downloads**: 346
- **Stars**: 7
- **Last updated**: 2025-09-25

Source: https://www.modelscope.cn/datasets/Alibaba-DT/SKYLENAGE-GameCodeGym

---

[![Platform](https://img.shields.io/badge/Platform-SKYLENAGE-blue.svg)](https://skylenage.alibaba-inc.com/sla/home) 
[![Home](https://img.shields.io/badge/Homepage-🏠-blue.svg)](https://v-gamegym.github.io/index.html)
[![Leaderboard](https://img.shields.io/badge/Leaderboard-🏆-brightgreen.svg)](https://v-gamegym.github.io/leaderboard.html)
[![Paper](https://img.shields.io/badge/Paper-📄-b31b1b.svg)](https://arxiv.org/abs/2509.20136) 
[![Code](https://img.shields.io/badge/Code-💻-black.svg)](https://github.com/alibaba/SKYLENAGE-GameCodeGym/) 


# I. Benchmark Introduction  
**SKYLENAGE-GameCodeGym (V-GameGym)** is a comprehensive benchmark for code LLMs, addressing the lack of evaluation in visual game development.  
It includes **2,219 samples** across **100 clusters**, curated with a clustering-based method to ensure diversity and completeness.  

# II. Benchmark Features  
1. **Game-specific metrics**: Playability, aesthetics, and user engagement.  
2. **Multimodal evaluation**: LLM-driven visual code synthesis in a UI sandbox.  
3. **Validated effectiveness**: Narrows the gap between code accuracy and real workflows.  
4. **Quantifiable results**: Provides measurable indicators for visual programming.  

# III. LeaderBoard
| Rank | Model Name                        | Company     | Total | Code  | Screenshot | Video | Release Date |
|------|-----------------------------------|-------------|-------|-------|------------|-------|--------------|
| 🥇 1 | GPT-5-20250807                    | OpenAI      | 45.0  | 96.6  | 17.6       | 20.7  | 2025-08-07   |
| 🥈 2 | GPT-o3                            | OpenAI      | 44.8  | 92.3  | 20.2       | 21.9  | 2025-04-16   |
| 🥉 3 | Gemini-2.5-pro                    | Google      | 43.5  | 89.1  | 19.1       | 22.2  | 2025-06-17   |
| 4    | GPT-5-mini                        | OpenAI      | 43.5  | 96.7  | 15.7       | 18.0  | 2025-08-07   |
| 5    | GPT-oss-120b                      | OpenAI      | 43.4  | 90.1  | 19.7       | 20.3  | 2025-08-21   |
| 6    | GPT-04-mini (high)                | OpenAI      | 43.0  | 87.8  | 19.8       | 21.4  | 2025-04-16   |
| 7    | Qwen3-235B-A22B-2507 (Thinking)   | Alibaba     | 42.3  | 84.5  | 20.0       | 22.4  | 2025-07-25   |
| 8    | Grok-4-0709                       | xAI         | 42.0  | 83.9  | 19.8       | 22.4  | 2025-07-09   |
| 9    | Gemini-2.5-flash                  | Google      | 42.0  | 92.8  | 16.5       | 16.7  | 2025-06-17   |
| 10   | Qwen3-Coder-480B-A35B-Instruct    | Alibaba     | 41.4  | 85.3  | 18.3       | 20.5  | 2025-07-23   |
| 11   | DeepSeek-V3-0324                  | DeepSeek    | 41.2  | 83.7  | 19.3       | 20.5  | 2025-03-24   |
| 12   | Qwen3-235B-A22B-Instruct-2507     | Alibaba     | 41.1  | 85.3  | 18.2       | 19.7  | 2025-07-21   |
| 13   | DeepSeek-V3.1                     | DeepSeek    | 40.9  | 83.1  | 19.3       | 20.2  | 2025-08-21   |
| 14   | Claude-Sonnet-4-20250514-Thinking | Anthropic   | 40.5  | 90.3  | 14.4       | 16.9  | 2025-05-14   |
| 15   | Seed-OSS-36B-Instruct             | ByteDance   | 40.3  | 88.3  | 16.4       | 16.2  | 2025-08-21   |
| 16   | GLM-4.5                           | Zhipu AI    | 40.0  | 84.7  | 17.0       | 18.3  | 2025-07-28   |

---

# IV. Contact Us
For more details, please visit the **SKYLENAGE Platform**:  
https://skylenage.alibaba-inc.com/sla/home  

Contact us: **skylenage@service.alibaba.com**