---
title: Arctic-LSTM-Speculator-gpt-oss-20b
canonical_url: "https://www.modelscope.cn/models/AI-ModelScope/Arctic-LSTM-Speculator-gpt-oss-20b"
md_url: "https://www.modelscope.cn/models/AI-ModelScope/Arctic-LSTM-Speculator-gpt-oss-20b.md"
repository: AI-ModelScope/Arctic-LSTM-Speculator-gpt-oss-20b
last_updated: 2025-09-04
license: apache-2.0
model_type:
  - mlp_speculator
architectures:
  - ArcticLSTMSpeculatorPreTrainedModel
library_name:
  - pytorch
frameworks:
  - pytorch
downloads: 109
stars: 0
---

# Arctic-LSTM-Speculator-gpt-oss-20b

> Arctic-LSTM-Speculator-gpt-oss-20b - AI-ModelScope 在 ModelScope 开源的模型。Build the fastest OSS vllm-based speculative decoding system for your own model, using ArcticTraining and ArcticInference!

AI-ModelScope/Arctic-LSTM-Speculator-gpt-oss-20b 是 ModelScope 魔搭社区上的机器学习模型，采用 apache-2.0 许可。

- **Repository**: AI-ModelScope/Arctic-LSTM-Speculator-gpt-oss-20b
- **License**: apache-2.0
- **Downloads**: 109
- **Stars**: 0
- **Last updated**: 2025-09-04

Source: https://www.modelscope.cn/models/AI-ModelScope/Arctic-LSTM-Speculator-gpt-oss-20b

---

# ArcticSpeculator

Build the fastest OSS vllm-based speculative decoding system for your own model, using [ArcticTraining](https://github.com/snowflakedb/ArcticTraining) and [ArcticInference](https://github.com/snowflakedb/ArcticInference)!

<!--We compare the throughput (tokens/s) of existing vllm-based speculative decoding systems for Llama3.1-70B-Instruct on 8xH100 as below:

| method                                 | ShareGPT      | HumanEval |
|--------------------------------------|----------------|--------------|
| VLLM V1 Baseline      | 84.1 | 84.1    |
| VLLM V1 Eagle | 102.2   | 112.0    |
| VLLM V1 Eagle3  | 77.7   | 85.3 |
| VLLM V0 MLP-Speculator (IBM) | 77.9   | 66.7        |
| ArcticSpeculator                          | **172.4**   | **203.7**    |
-->

For more details about ArcticSpeculator and how to use it:

* ❄️ [Using Arctic-Inference and Arctic-Training for improving real-world speculative decoding Performance (blog)]()
* 🚀 [Getting started guide using ArcticTraining](https://github.com/snowflakedb/ArcticTraining/tree/mlp-variant-speculator/projects/mlp_variant_speculator)

See all of the speculators we have released via our [Speculators Collection](https://huggingface.co/collections/Snowflake/speculators-6812b07f3186d13e243022e4)