---
title: LBS-27B
canonical_url: "https://www.modelscope.cn/models/inclusionAI/LBS-27B"
md_url: "https://www.modelscope.cn/models/inclusionAI/LBS-27B.md"
repository: inclusionAI/LBS-27B
last_updated: 2026-10-26
license: apache-2.0
pipeline_tag: image-text-to-text
tasks:
  - image-text-to-text
model_type:
  - qwen3_5
architectures:
  - Qwen3_5ForConditionalGeneration
parameters: 27.4B
tensor_type:
  - BF16
library_name:
  - safetensors
  - pytorch
frameworks:
  - pytorch
downloads: 13
stars: 0
tags:
  - gui-grounding
  - agentic-vision
  - visual-question-answering
  - high-resolution
  - reinforcement-learning
---

# LBS-27B

> LBS-27B - inclusionAI 在 ModelScope 开源的模型。Learning to Look Beyond Screens: Transferable Visual Observation from GUI Grounding

inclusionAI/LBS-27B 是 ModelScope 魔搭社区上的 27.4B 参数image-text-to-text模型，采用 apache-2.0 许可。

- **Repository**: inclusionAI/LBS-27B
- **License**: apache-2.0
- **Tasks**: image-text-to-text
- **Parameters**: 27.4B
- **Tags**: gui-grounding, agentic-vision, visual-question-answering, high-resolution, reinforcement-learning
- **Downloads**: 13
- **Stars**: 0
- **Last updated**: 2026-10-26

Source: https://www.modelscope.cn/models/inclusionAI/LBS-27B

---

# LBS-27B

**Learning to Look Beyond Screens: Transferable Visual Observation from GUI Grounding**

[💻 Project](https://github.com/inclusionAI/UI-Venus/tree/LBS) ·
[🤗 Collection](https://huggingface.co/collections/inclusionAI/ui-venus)

## Model Summary

**LBS-27B** is an agentic vision-language model based on **Qwen3.8-27b**. It
learns to select and inspect image regions through GUI grounding, then transfers
this observation policy to general-domain visual question answering and
high-resolution perception.

Training uses **only synthetic GUI grounding data**, with no general-domain
data or VQA questions: approximately **10K cold-start SFT examples**, followed
by **80 GRPO steps** with a batch size of **64** and **8 rollouts per prompt**.

- **Adaptive observation:** zoom into relevant regions, refine previous crops,
  and revisit the original image when needed.
- **Compositional zoom-in:** request up to two independent crops per turn,
  with a total budget of three crop calls per episode.
- **Transfer beyond screens:** apply the learned observation policy to visual
  QA without general-domain VQA training.

## Results

![LBS results on ScreenSpot-Pro and PerceptionBench](https://raw.githubusercontent.com/inclusionAI/UI-Venus/LBS/docs/assets/benchmark_overview/benchmark_overview.png)

| Benchmark | Records | Metric | Score (%) |
|---|---:|---|---:|
| ScreenSpot-Pro | 1,581 | Action accuracy | **81.15** |
| OS-World-G (Refine) | 564 | Action accuracy, including refusal | **84.57** |
| PerceptionBench | 3,000 | Judge accuracy | **59.67** |
| HR-Bench 4K | 800 | Strict option matching | **89.13** |
| HR-Bench 8K | 800 | Strict option matching | **87.75** |

All LBS scores use **agentic zoom-in** over complete benchmark runs.
PerceptionBench uses a **self-hosted Deepseekv4-flash-0731** judge, with zero
failed or skipped judgments; repeated judgments may vary. Chart references use
different inference setups and GPT-oss-120B for PerceptionBench, so comparisons
are not controlled. See [comparison notes](https://github.com/inclusionAI/UI-Venus/blob/LBS/docs/BENCHMARK_OVERVIEW.md).

More result visualizations are available in the [LBS project](https://github.com/inclusionAI/UI-Venus/tree/LBS);
we have not performed any additional fine-tuning on general-domain data and
welcome further RL experiments in specific subdomains.

## Usage

Serve the released checkpoint in a compatible vLLM environment. Adjust the
four-device example below for your hardware:

```bash
git clone --branch LBS --single-branch https://github.com/inclusionAI/UI-Venus.git
cd UI-Venus/evaluation
bash scripts/serve_vllm.sh start inclusionAI/LBS-27B \
  --name lbs --tp 4 --dp 1 --daemon
```

LBS emits plain-text `crop_image` actions. A client must execute the crops and
return the images and coordinate mappings for multi-turn inference. Final GUI
coordinates use `[x.xx,y.yy]`, normalized to **[0,1000] on the original image**.
Grounding predicts a location; operating a live application requires a separate
executor.

The [evaluation guide](https://github.com/inclusionAI/UI-Venus/blob/LBS/evaluation/README.md)
provides the client and benchmark setup. Configure endpoints and credentials in
an ignored `.env.run` copied from `.env.example`, using the actual model ID from
`/v1/models`. Wrappers default to `reasoning_effort=xhigh` and
`thinking_budget=4096` through `chat_template_kwargs`; direct Python entries can
default to `high`.

## License

The model weights and project software are released under **Apache 2.0**.
Third-party datasets and screenshots retain their original licenses and terms.