---
title: Seed-X-Instruct-fp8
canonical_url: "https://www.modelscope.cn/models/ivanwaldon/Seed-X-Instruct-fp8"
md_url: "https://www.modelscope.cn/models/ivanwaldon/Seed-X-Instruct-fp8.md"
repository: ivanwaldon/Seed-X-Instruct-fp8
last_updated: 2026-03-22
license: "Apache License 2.0"
pipeline_tag: translation
tasks:
  - translation
model_type:
  - mistral
architectures:
  - MistralForCausalLM
parameters: 7.5B
tensor_type:
  - F16
  - F32
  - F8_E4M3
library_name:
  - safetensors
  - pytorch
frameworks:
  - Pytorch
inference_backends:
  - "deploy_task text/emb"
  - "lmdeploy 0.9.1"
  - "lmdeploy_turbomind 0.9.1"
  - "sglang 0.5.2"
  - "vllm 0.9.2"
downloads: 10
stars: 2
---

# Seed-X-Instruct-fp8

> Seed-X-Instruct-fp8 - ivanwaldon 在 ModelScope 开源的模型。目前ModelOpt量化的模型只能通过vllm，TensorRT-LLM调用。量化后在4060ti 16GB上可以做到2000token/s（并发）。 您可以通过如下git clone命令，或者ModelScope SDK来下载模型

ivanwaldon/Seed-X-Instruct-fp8 是 ModelScope 魔搭社区上的 7.5B 参数translation模型，采用 Apache License 2.0 许可，可用 deploy_task text/emb、lmdeploy 0.9.1、lmdeploy_turbomind 0.9.1 部署。

- **Repository**: ivanwaldon/Seed-X-Instruct-fp8
- **License**: Apache License 2.0
- **Tasks**: translation
- **Parameters**: 7.5B
- **Inference backends**: deploy_task text/emb, lmdeploy 0.9.1, lmdeploy_turbomind 0.9.1, sglang 0.5.2, vllm 0.9.2
- **Downloads**: 10
- **Stars**: 2
- **Last updated**: 2026-03-22

Source: https://www.modelscope.cn/models/ivanwaldon/Seed-X-Instruct-fp8

---

### 目前ModelOpt量化的模型只能通过vllm，TensorRT-LLM调用。量化后在4060ti 16GB上可以做到2000token/s（并发）。
#### 您可以通过如下git clone命令，或者ModelScope SDK来下载模型

SDK下载
```bash
#安装ModelScope
pip install modelscope
```
```python
#SDK模型下载
from modelscope import snapshot_download
model_dir = snapshot_download('ivanwaldon/Seed-X-Instruct-fp8')
```
Git下载
```
#Git模型下载
git clone https://www.modelscope.cn/ivanwaldon/Seed-X-Instruct-fp8.git
```

<p style="color: lightgrey;">如果您是本模型的贡献者，我们邀请您根据<a href="https://modelscope.cn/docs/ModelScope%E6%A8%A1%E5%9E%8B%E6%8E%A5%E5%85%A5%E6%B5%81%E7%A8%8B%E6%A6%82%E8%A7%88" style="color: lightgrey; text-decoration: underline;">模型贡献文档</a>，及时完善模型卡片内容。</p>
