---
title: Event-Bench
canonical_url: "https://www.modelscope.cn/datasets/AI-ModelScope/Event-Bench"
md_url: "https://www.modelscope.cn/datasets/AI-ModelScope/Event-Bench.md"
repository: AI-ModelScope/Event-Bench
chinese_name: Event-Bench
last_updated: 2024-12-13
license: "Apache License 2.0"
storage_size: "5.6 MB"
downloads: 2020
stars: 0
---

# Event-Bench

> Event-Bench - AI-ModelScope 在 ModelScope 开源的数据集。Towards Event-oriented Long Video Understanding

AI-ModelScope/Event-Bench 是 ModelScope 魔搭社区上的数据集，存储大小 5.6 MB，采用 Apache License 2.0 许可。

- **Repository**: AI-ModelScope/Event-Bench
- **License**: Apache License 2.0
- **Storage size**: 5.6 MB
- **Downloads**: 2020
- **Stars**: 0
- **Last updated**: 2024-12-13

Source: https://www.modelscope.cn/datasets/AI-ModelScope/Event-Bench

---

# Towards Event-oriented Long Video Understanding



<font size=3><div align='center'> [[📖 arXiv Paper]()]</div>

---



## 👀 Overview

We introduce **Event-Bench**, an event-oriented long video understanding benchmark built on existing datasets and human annotations. **Event-Bench** consists of three event understanding abilities and six event-related tasks, including 2,190 test instances to comprehensively evaluate the ability to understand video events.
<p align="center">
    <img src="./asset/fig_benchmark.jpg" width="100%" height="100%">
</p>


**Event-Bench** provides a systematic comparison across different kinds of capabilities for existing video MLLMs, and points out the major shortcomings of open-source MLLMs.


## 🔍 Dataset
Download the raw videos in Event-Bench from the [google drive link](https://drive.google.com/file/d/1wjjH2dK-KpaObFdS1yc-TBUTCvXsaLwc/view?usp=sharing).

**License**:
```
Event-Bench is only used for academic research. Commercial use in any form is prohibited.
```


## 🔮 Evaluation Pipeline
Please refer to https://github.com/RUCAIBox/Event-Bench


## 📈 Experimental Results
- **Evaluation results of different Video MLLMs.**

<p align="center">
    <img src="./asset/performance.png" width="96%" height="50%">
</p>




## Citation

If you find our work helpful for your research, please consider citing our work.   

```bibtex
@misc{du2024eventoriented,
    title={Towards Event-oriented Long Video Understanding},
    author={Yifan Du and Kun Zhou and Yuqi Huo and Yifan Li and Wayne Xin Zhao and Haoyu Lu and Zijia Zhao and Bingning Wang and Weipeng Chen and Ji-Rong Wen},
    year={2024},
    eprint={2406.14129},
    archivePrefix={arXiv},
    primaryClass={cs.CV}
}
```