---
title: Helium1-VL-2B
canonical_url: "https://www.modelscope.cn/models/AI-ModelScope/Helium1-VL-2B"
md_url: "https://www.modelscope.cn/models/AI-ModelScope/Helium1-VL-2B.md"
repository: AI-ModelScope/Helium1-VL-2B
last_updated: 2025-12-25
license: cc-by-nc-sa-4.0
pipeline_tag: image-text-to-text
tasks:
  - image-text-to-text
model_type:
  - Helium1_VL_2B
base_model:
  - kyutai/helium-1-2b
base_model_relation: finetune
parameters: 2.7B
tensor_type:
  - F32
library_name:
  - pytorch
  - safetensors
frameworks:
  - pytorch
language:
  - en
downloads: 53
stars: 0
---

# Helium1-VL-2B

> Helium1-VL-2B - AI-ModelScope 在 ModelScope 开源的模型。Helium1-VL-2B is an instruct-tuned vision-language model (VLM) based on the Helium1-2B text-only language model and a pretrained vision encoder from Qwen-2.5VL.

AI-ModelScope/Helium1-VL-2B 是 ModelScope 魔搭社区上的 2.7B 参数image-text-to-text模型，采用 cc-by-nc-sa-4.0 许可，基于 kyutai/helium-1-2b 构建。

- **Repository**: AI-ModelScope/Helium1-VL-2B
- **License**: cc-by-nc-sa-4.0
- **Tasks**: image-text-to-text
- **Parameters**: 2.7B
- **Base model**: kyutai/helium-1-2b
- **Downloads**: 53
- **Stars**: 0
- **Last updated**: 2025-12-25

Source: https://www.modelscope.cn/models/AI-ModelScope/Helium1-VL-2B

---

# Helium1-VL-2B

`Helium1-VL-2B` is an instruct-tuned vision-language model (VLM) based on the [Helium1-2B](https://huggingface.co/kyutai/helium-1-2b) text-only language model and a pretrained vision encoder from [Qwen-2.5VL](https://huggingface.co/Qwen/Qwen2.5-VL-3B-Instruct).

This model is released as part of the **CASA** project. While the CASA architecture focuses on cross-attention fusion, `Helium1-VL-2B` serves as a high-performance **token insertion** baseline, achieving state-of-the-art results among models of comparable size trained on publicly available datasets.

- **Paper:** [CASA: Cross-Attention via Self-Attention for Efficient Vision-Language Fusion](https://huggingface.co/papers/2512.19535)
- **Project Page:** [https://kyutai.org/casa](https://kyutai.org/casa)
- **GitHub Repository:** [https://github.com/kyutai-labs/casa](https://github.com/kyutai-labs/casa)

## Sample Usage

You can run inference using the following code snippet. This model requires `trust_remote_code=True` to load the custom architecture.

```python
import torch
from transformers.models.auto.modeling_auto import AutoModel
from transformers.models.auto.processing_auto import AutoProcessor

model_id = "kyutai/Helium1-VL-2B"
model = AutoModel.from_pretrained(
    model_id,
    torch_dtype=torch.bfloat16,
    attn_implementation="flash_attention_2",
    trust_remote_code=True,
).cuda()
processor = AutoProcessor.from_pretrained(
    model_id,
    trust_remote_code=True,
)

conversation = [
    {
        "role": "user",
        "content": [
            {
                "type": "image",
                "image": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/transformers/tasks/ai2d-demo.png",
            },
            {
                "type": "text",
                "text": "Describe this image.",
            },
        ],
    },
]

inputs = processor.tokenize_messages(messages=conversation)
inputs = inputs.to(model.device)
input_len = inputs["input_ids"].shape[1]

output_ids = model.generate_from_image(
  **inputs,
  max_new_tokens=512,
  pre_image_tokens=processor.pre_image_tokens,
  post_image_tokens=processor.post_image_tokens,
  eos_token_id=model.generation_config.eos_token_id,
)[0, input_len:]

response = processor.tokenizer.decode(output_ids, skip_special_tokens=True)
print(response)
```

## Citation

If you use this model or the CASA fusion paradigm in your research, please cite:

```bibtex
@article{kyutai2025casa,
  author = {Moritz B\"ohle and Am\'elie Royer and Juliette Marrie and Edouard Grave and Patrick P\'erez},
  year = {2025},
  title = {CASA: Cross-Attention via Self-Attention for Efficient Vision-Language Fusion},
  journal = {ArXiv},
  url = {https://arxiv.org/abs/2512.19535}
}
```