---
title: CoDeTT
canonical_url: "https://www.modelscope.cn/datasets/wyawya/CoDeTT"
md_url: "https://www.modelscope.cn/datasets/wyawya/CoDeTT.md"
repository: wyawya/CoDeTT
chinese_name: CoDeTT
last_updated: 2026-04-02
license: apache-2.0
storage_size: "48 GB"
downloads: 198
stars: 1
---

# CoDeTT

> CoDeTT - wyawya 在 ModelScope 开源的数据集。CoDeTT: A Context-Aware Decision Benchmark for Turn-Taking Evaluation

wyawya/CoDeTT 是 ModelScope 魔搭社区上的数据集，存储大小 48 GB，采用 apache-2.0 许可。

- **Repository**: wyawya/CoDeTT
- **License**: apache-2.0
- **Storage size**: 48 GB
- **Downloads**: 198
- **Stars**: 1
- **Last updated**: 2026-04-02

Source: https://www.modelscope.cn/datasets/wyawya/CoDeTT

---

# CoDeTT: A Context-Aware Decision Benchmark for Turn-Taking Evaluation

## 🌐 Dataset Summary

CoDeTT is a benchmark dataset for turn-taking decision evaluation in full-duplex spoken dialogue systems.  
It evaluates not only what action a model should take at the current moment, but also whether the underlying semantic intent is aligned.

Core action space (4 classes):
- `Maintain`
- `Stop & Listen`
- `Takeover`
- `Dismiss`

Fine-grained intent space:
- 14 scenario labels across two system states: `SystemSpeaking` and `SystemIdle`.

## 🧩 Task Definition

Given:
- Current system state
- Multi-turn dialogue history
- Current target input

Predict:
- Turn-taking action at the current timestamp (4-way)
- Optional fine-grained intent category (14-way)

## 🏷️ Label Taxonomy

### SystemSpeaking
- `Maintain`:
  - `Backchannel`
  - `Invalidation`
  - `Side-talk`
  - `Distraction`
- `Stop & Listen`:
  - `Interruption`
  - `Dismissal`
  - `Collaboration`

### SystemIdle
- `Takeover`:
  - `Completion`
  - `Cooperation`
- `Dismiss`:
  - `Incomplete`
  - `Invalidation`
  - `Dismissal`
  - `Exclusion`
  - `Side-talk`

## 🗂️ Data Structure (Full Directory Tree)

```text
Benchmark_Datasets
├── .cache
├── audios
│   ├── EN
│   │   ├── real
│   │   │   ├── System_Idle
│   │   │   │   ├── Dismiss
│   │   │   │   │   └── Incomplete
│   │   │   │   └── Takeover
│   │   │   │       └── Completion
│   │   │   └── System_Speaking
│   │   │       ├── Maintain
│   │   │       │   └── Backchannel
│   │   │       └── Stop_Listen
│   │   │           └── Interruption
│   │   └── syn
│   │       ├── SystemIdle
│   │       │   ├── Dismiss
│   │       │   │   ├── Dismissal
│   │       │   │   ├── Exclusion
│   │       │   │   ├── Incomplete
│   │       │   │   ├── Invalidation
│   │       │   │   └── SideTalk
│   │       │   └── Takeover
│   │       │       ├── Completion
│   │       │       └── Cooperation
│   │       └── SystemSpeaking
│   │           ├── Maintain
│   │           │   ├── Backchannel
│   │           │   ├── Distraction
│   │           │   ├── Invalidation
│   │           │   └── SideTalk
│   │           └── StopandListen
│   │               ├── Collaboration
│   │               ├── Dismissal
│   │               └── Interruption
│   └── ZH
│       ├── real
│       │   ├── System_Idle
│       │   │   ├── Dismiss
│       │   │   │   └── Incomplete
│       │   │   └── Takeover
│       │   │       └── Completion
│       │   └── System_Speaking
│       │       ├── Maintain
│       │       │   └── Backchannel
│       │       └── Stop_Listen
│       │           └── Interruption
│       └── syn
│           ├── SystemIdle
│           │   ├── Dismiss
│           │   │   ├── Dismissal
│           │   │   ├── Exclusion
│           │   │   ├── Incomplete
│           │   │   ├── Invalidation
│           │   │   └── SideTalk
│           │   └── Takeover
│           │       ├── Completion
│           │       └── Cooperation
│           └── SystemSpeaking
│               ├── Maintain
│               │   ├── Backchannel
│               │   ├── Distraction
│               │   ├── Invalidation
│               │   └── SideTalk
│               └── StopandListen
│                   ├── Collaboration
│                   ├── Dismissal
│                   └── Interruption
└── jsonls
    ├── EN
    │   ├── real
    │   │   ├── SystemIdle_Dismiss_Incomplete.jsonl
    │   │   ├── SystemIdle_Takeover_Completion.jsonl
    │   │   ├── SystemSpeaking_Maintain_Backchannel.jsonl
    │   │   └── SystemSpeaking_StopandListen_Interruption.jsonl
    │   └── syn
    │       ├── SystemIdle_Dismiss_Dismissal.jsonl
    │       ├── SystemIdle_Dismiss_Exclusion.jsonl
    │       ├── SystemIdle_Dismiss_Incomplete.jsonl
    │       ├── SystemIdle_Dismiss_Invalidation.jsonl
    │       ├── SystemIdle_Dismiss_SideTalk.jsonl
    │       ├── SystemIdle_Takeover_Completion.jsonl
    │       ├── SystemIdle_Takeover_Cooperation.jsonl
    │       ├── SystemSpeaking_Maintain_Backchannel.jsonl
    │       ├── SystemSpeaking_Maintain_Distraction.jsonl
    │       ├── SystemSpeaking_Maintain_Invalidation.jsonl
    │       ├── SystemSpeaking_Maintain_SideTalk.jsonl
    │       ├── SystemSpeaking_StopandListen_Collaboration.jsonl
    │       ├── SystemSpeaking_StopandListen_Dismissal.jsonl
    │       └── SystemSpeaking_StopandListen_Interruption.jsonl
    └── ZH
        ├── real
        │   ├── SystemIdle_Dismiss_Incomplete.jsonl
        │   ├── SystemIdle_Takeover_Completion.jsonl
        │   ├── SystemSpeaking_Maintain_Backchannel.jsonl
        │   └── SystemSpeaking_StopandListen_Interruption.jsonl
        └── syn
            ├── SystemIdle_Dismiss_Dismissal.jsonl
            ├── SystemIdle_Dismiss_Exclusion.jsonl
            ├── SystemIdle_Dismiss_Incomplete.jsonl
            ├── SystemIdle_Dismiss_Invalidation.jsonl
            ├── SystemIdle_Dismiss_SideTalk.jsonl
            ├── SystemIdle_Takeover_Completion.jsonl
            ├── SystemIdle_Takeover_Cooperation.jsonl
            ├── SystemSpeaking_Maintain_Backchannel.jsonl
            ├── SystemSpeaking_Maintain_Distraction.jsonl
            ├── SystemSpeaking_Maintain_Invalidation.jsonl
            ├── SystemSpeaking_Maintain_SideTalk.jsonl
            ├── SystemSpeaking_StopandListen_Collaboration.jsonl
            ├── SystemSpeaking_StopandListen_Dismissal.jsonl
            └── SystemSpeaking_StopandListen_Interruption.jsonl
```

## 📦 Quick Start

```bash
mkdir -p ./CoDeTT && lz4 -dc ./CoDeTT.lz4 | tar -x -C ./CoDeTT
```

## 📏 Evaluation Protocol

### Stage 1: Action Level
All models are evaluated in the unified 4-action space (Takeover / Maintain / Stop & Listen / Dismiss), enabling fair comparison across different model paradigms.

### Stage 2: Intent Level
Models with stronger semantic reasoning capabilities are further evaluated on direct prediction of all 14 fine-grained intent categories.

## 📊 Metrics

- `ACC` (Accuracy): Action-level prediction accuracy
- `SMR` (Semantic Misalignment Rate): The proportion of semantically incorrect intent predictions among action-correct samples

## 🚀 Use Cases

- Turn-taking evaluation for full-duplex voice assistants and speech agents
- Context understanding analysis for speech-language models in complex conversations
- Multi-speaker interaction and floor-management research
- Diagnosis of "action-correct but reason-wrong" behaviors
- Bilingual and cross-lingual turn-taking benchmarking (English/Chinese)

## 📚 Citation

If you use CoDeTT or reference its benchmark design, please cite:

```bibtex
@article{shen2026codett,
  title={CoDeTT: A Context-Aware Decision Benchmark for Turn-Taking Evaluation},
  author={Shen, Huan and Wang, Yingao and Huang, Shangkun and Zou, Wei and Chen, Yunzhang},
  journal={arXiv preprint arXiv:2603.25434},
  year={2026}
}
```