---
title: Qwen2.5-32B-Instruct-FP8-dynamic
canonical_url: "https://www.modelscope.cn/models/nm-testing/Qwen2.5-32B-Instruct-FP8-dynamic"
md_url: "https://www.modelscope.cn/models/nm-testing/Qwen2.5-32B-Instruct-FP8-dynamic.md"
repository: nm-testing/Qwen2.5-32B-Instruct-FP8-dynamic
last_updated: 2025-02-26
model_type:
  - qwen2
architectures:
  - Qwen2ForCausalLM
base_model:
  - Qwen/Qwen2.5-32B-Instruct
base_model_relation: quantized
parameters: 32.8B
tensor_type:
  - BF16
  - F8_E4M3
library_name:
  - safetensors
  - pytorch
frameworks:
  - pytorch
inference_backends:
  - "deploy_task text/emb"
  - "lmdeploy 0.9.1"
  - "lmdeploy_turbomind 0.9.1"
  - "sglang 0.5.2"
  - "vllm 0.9.2"
downloads: 710
stars: 0
---

# Qwen2.5-32B-Instruct-FP8-dynamic

> Qwen2.5-32B-Instruct-FP8-dynamic - nm-testing 在 ModelScope 开源的模型。

nm-testing/Qwen2.5-32B-Instruct-FP8-dynamic 是 ModelScope 魔搭社区上的 32.8B 参数机器学习模型，基于 Qwen/Qwen2.5-32B-Instruct 构建，可用 deploy_task text/emb、lmdeploy 0.9.1、lmdeploy_turbomind 0.9.1 部署。

- **Repository**: nm-testing/Qwen2.5-32B-Instruct-FP8-dynamic
- **Parameters**: 32.8B
- **Base model**: Qwen/Qwen2.5-32B-Instruct
- **Inference backends**: deploy_task text/emb, lmdeploy 0.9.1, lmdeploy_turbomind 0.9.1, sglang 0.5.2, vllm 0.9.2
- **Downloads**: 710
- **Stars**: 0
- **Last updated**: 2025-02-26

Source: https://www.modelscope.cn/models/nm-testing/Qwen2.5-32B-Instruct-FP8-dynamic

---

<!-- 该仓库未提供 README 正文；以上元信息即为全部可用内容 -->