---
title: Arctic-LSTM-Speculator-gpt-oss-120b
canonical_url: "https://www.modelscope.cn/models/AI-ModelScope/Arctic-LSTM-Speculator-gpt-oss-120b"
md_url: "https://www.modelscope.cn/models/AI-ModelScope/Arctic-LSTM-Speculator-gpt-oss-120b.md"
repository: AI-ModelScope/Arctic-LSTM-Speculator-gpt-oss-120b
last_updated: 2025-09-04
license: apache-2.0
model_type:
  - mlp_speculator
architectures:
  - ArcticLSTMSpeculatorPreTrainedModel
library_name:
  - pytorch
frameworks:
  - pytorch
downloads: 114
stars: 0
---

# Arctic-LSTM-Speculator-gpt-oss-120b

> Arctic-LSTM-Speculator-gpt-oss-120b - AI-ModelScope 在 ModelScope 开源的模型。Build the fastest OSS vllm-based speculative decoding system for your own model, using ArcticTraining and ArcticInference!

AI-ModelScope/Arctic-LSTM-Speculator-gpt-oss-120b 是 ModelScope 魔搭社区上的机器学习模型，采用 apache-2.0 许可。

- **Repository**: AI-ModelScope/Arctic-LSTM-Speculator-gpt-oss-120b
- **License**: apache-2.0
- **Downloads**: 114
- **Stars**: 0
- **Last updated**: 2025-09-04

Source: https://www.modelscope.cn/models/AI-ModelScope/Arctic-LSTM-Speculator-gpt-oss-120b

---

# ArcticSpeculator

Build the fastest OSS vllm-based speculative decoding system for your own model, using [ArcticTraining](https://github.com/snowflakedb/ArcticTraining) and [ArcticInference](https://github.com/snowflakedb/ArcticInference)!

Throughput (tokens/s) of gpt-oss-120b on 8xH100 using vLLM below:

| method                                 | ShareGPT      | HumanEval |
|--------------------------------------|----------------|--------------|
| vLLM V1 Baseline      | 220.2 | 220.7    |
| ArcticSpeculator                          | **377.3**   | **400.0**    |

For more details about ArcticSpeculator and how to use it:

* ❄️ [Using Arctic-Inference and Arctic-Training for improving real-world speculative decoding Performance (blog)]()
* 🚀 [Getting started guide using ArcticTraining](https://github.com/snowflakedb/ArcticTraining/tree/mlp-variant-speculator/projects/mlp_variant_speculator)

See all of the speculators we have released via our [Speculators Collection](https://huggingface.co/collections/Snowflake/speculators-6812b07f3186d13e243022e4)