---
title: AraDICE-ArabicMMLU-egy
canonical_url: "https://www.modelscope.cn/datasets/QCRI/AraDICE-ArabicMMLU-egy"
md_url: "https://www.modelscope.cn/datasets/QCRI/AraDICE-ArabicMMLU-egy.md"
repository: QCRI/AraDICE-ArabicMMLU-egy
last_updated: 2025-06-17
license: "Apache License 2.0"
storage_size: "12 MB"
downloads: 659
stars: 0
---

# AraDICE-ArabicMMLU-egy

> AraDICE-ArabicMMLU-egy - QCRI 在 ModelScope 开源的数据集。AraDiCE: Benchmarks for Dialectal and Cultural Capabilities in LLMs -- ArabicMMLU - Egyptian dialect

QCRI/AraDICE-ArabicMMLU-egy 是 ModelScope 魔搭社区上的数据集，存储大小 12 MB，采用 Apache License 2.0 许可。

- **Repository**: QCRI/AraDICE-ArabicMMLU-egy
- **License**: Apache License 2.0
- **Storage size**: 12 MB
- **Downloads**: 659
- **Stars**: 0
- **Last updated**: 2025-06-17

Source: https://www.modelscope.cn/datasets/QCRI/AraDICE-ArabicMMLU-egy

---

# AraDiCE: Benchmarks for Dialectal and Cultural Capabilities in LLMs -- ArabicMMLU - Egyptian dialect

## Overview

The **AraDiCE** dataset is crafted to assess the dialectal and cultural understanding of large language models (LLMs) within Arabic-speaking contexts. It includes post-edited adaptations of several benchmark datasets, specifically curated to validate LLM performance in culturally and dialectally relevant scenarios for Arabic.

Within the AraDiCE collection, this particular subset is designated as **ArabicMMLU - Egyptian Dialect**.

## Dataset Usage

The AraDiCE dataset is intended to be used for benchmarking and evaluating large language models, specifically focusing on:

- Assessing the performance of LLMs on Arabic-specific dialect and cultural specifics.
- Dialectal variations in the Arabic language.
- Cultural context awareness in reasoning.

## Evaluation
We have used [lm-harness](https://github.com/EleutherAI/lm-evaluation-harness) eval framework to for the benchmarking. We will soon release them. Stay tuned!!

## Machine Translation Models
We will soon be releasing all our *machine translation models*. Stay tuned! For early access, feel free to contact us.



## License

The dataset is distributed under the **Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License (CC BY-NC-SA 4.0)**. The full license text can be found in the accompanying `licenses_by-nc-sa_4.0_legalcode.txt` file.


## Citation
Please find the paper <a href="https://arxiv.org/pdf/2409.11404" target="_blank" style="margin-right: 15px; margin-left: 10px">here.</a>

```
@article{mousi2024aradicebenchmarksdialectalcultural,
      title={{AraDiCE}: Benchmarks for Dialectal and Cultural Capabilities in LLMs},
      author={Basel Mousi and Nadir Durrani and Fatema Ahmad and Md. Arid Hasan and Maram Hasanain and Tameem Kabbani and Fahim Dalvi and Shammur Absar Chowdhury and Firoj Alam},
      year={2024},
      publisher={arXiv:2409.11404},
      url={https://arxiv.org/abs/2409.11404},
}
```