---
title: Hand-Qwen3-235B-A22B-W8A8
canonical_url: "https://www.modelscope.cn/models/jaywoods/Hand-Qwen3-235B-A22B-W8A8"
md_url: "https://www.modelscope.cn/models/jaywoods/Hand-Qwen3-235B-A22B-W8A8.md"
repository: jaywoods/Hand-Qwen3-235B-A22B-W8A8
last_updated: 2025-12-11
license: "Apache License 2.0"
model_type:
  - qwen3_moe
architectures:
  - Qwen3MoeForCausalLM
parameters: 235.3B
tensor_type:
  - BF16
  - F32
  - I32
  - I8
library_name:
  - safetensors
  - other
frameworks:
  - other
inference_backends:
  - "deploy_task text/emb"
  - "lmdeploy_turbomind 0.9.1"
  - "sglang 0.5.2"
  - "vllm 0.9.2"
downloads: 135
stars: 0
---

# Hand-Qwen3-235B-A22B-W8A8

> Hand-Qwen3-235B-A22B-W8A8 - jaywoods 在 ModelScope 开源的模型。废弃 本版存在较高频率出现 "游戏副本"字段 、"方块乱码" 已废弃，新的仓库已经修复，请使用 -> jaywoods/Qwen3-235B-A22B-W8A8

jaywoods/Hand-Qwen3-235B-A22B-W8A8 是 ModelScope 魔搭社区上的 235.3B 参数机器学习模型，采用 Apache License 2.0 许可，可用 deploy_task text/emb、lmdeploy_turbomind 0.9.1、sglang 0.5.2 部署。

- **Repository**: jaywoods/Hand-Qwen3-235B-A22B-W8A8
- **License**: Apache License 2.0
- **Parameters**: 235.3B
- **Inference backends**: deploy_task text/emb, lmdeploy_turbomind 0.9.1, sglang 0.5.2, vllm 0.9.2
- **Downloads**: 135
- **Stars**: 0
- **Last updated**: 2025-12-11

Source: https://www.modelscope.cn/models/jaywoods/Hand-Qwen3-235B-A22B-W8A8

---

## 废弃 本版存在较高频率出现 "游戏副本"字段 、"方块乱码" 已废弃，新的仓库已经修复，请使用 -> jaywoods/Qwen3-235B-A22B-W8A8

#### 您可以通过如下git clone命令，或者ModelScope SDK来下载模型

SDK下载
```bash
#安装ModelScope
pip install modelscope
```
```python
#SDK模型下载
from modelscope import snapshot_download
model_dir = snapshot_download('jaywoods/Hand-Qwen3-235B-A22B-W8A8')
```

Git下载
```
#Git模型下载
git clone https://www.modelscope.cn/jaywoods/Hand-Qwen3-235B-A22B-W8A8.git
```

#### 服务化推理

##### 创建mindie容器

对应的镜像介质，从昇腾官方申请获取

```bash
docker run -it -d --net=host --shm-size=512g \
    --privileged \
    --name qwen3 \
    -v /usr/local/Ascend/driver:/usr/local/Ascend/driver:ro \
    -v /usr/local/sbin:/usr/local/sbin:ro \
    -v /data/models:/data/models \
    mindie:xxxx bash
```

##### 配置文件参考

```bash
{
    "Version" : "1.0.0",

    "ServerConfig" :
    {
        "ipAddress" : "0.0.0.0",
        "managementIpAddress" : "0.0.0.0",
        "port" : 1025,
        "managementPort" : 1026,
        "metricsPort" : 1027,
        "allowAllZeroIpListening" : true,
        "maxLinkNum" : 1000,
        "httpsEnabled" : false,
        ......
    },

    "BackendConfig" : {
        "backendName" : "mindieservice_llm_engine",
        "modelInstanceNumber" : 1,
        "npuDeviceIds" : [[0,1,2,3,4,5,6,7]],
        "tokenizerProcessNumber" : 8,
        "multiNodesInferEnabled" : false,
        "multiNodesInferPort" : 1120,
        ......
        "ModelDeployConfig" :
        {
            "maxSeqLen" : 16384,
            "maxInputTokenLen" : 8192,
            "truncation" : false,
            "ModelConfig" : [
                {
                    "modelInstanceType" : "Standard",
                    "modelName" : "qwen3-235b",
                    "modelWeightPath" : "/data/jaywoods/Hand-Qwen3-235B-A22B-W8A8",
                    "worldSize" : 8,
                    "cpuMemSize" : 100,
                    "npuMemSize" : -1,
                    "backendType" : "atb",
                    "trustRemoteCode" : true
                }
            ]
        },

        "ScheduleConfig" :
        {
            "templateType" : "Standard",
            "templateName" : "Standard_LLM",
            "cacheBlockSize" : 128,

            "maxPrefillBatchSize" : 50,
            "maxPrefillTokens" : 10000,
            "prefillTimeMsPerReq" : 150,
            "prefillPolicyType" : 0,

            "decodeTimeMsPerReq" : 50,
            "decodePolicyType" : 0,

            "maxBatchSize" : 50,
            "maxIterTimes" : 8192,
            "maxPreemptCount" : 0,
            "supportSelectBatch" : false,
            "maxQueueDelayMicroseconds" : 5000
        }
    }
}
```

##### 启动

```bash
docker exec -it qwen3 bash
cd /usr/local/Ascend/mindie/latest/mindie-service
nohup bin/mindieservice_daemon &
```

##### 对话测试

```bash
curl 'http://127.0.0.1:1025/v1/chat/completions'  \
  -H 'Content-Type: application/json'  -d '{
  "model": "qwen3-235b",
  "stream": false,
  "messages": [
    {
      "role": "user",
      "content": "你是谁?/no_think"
    }
  ]
}'
```


<p style="color: lightgrey;">如果您是本模型的贡献者，我们邀请您根据<a href="https://modelscope.cn/docs/ModelScope%E6%A8%A1%E5%9E%8B%E6%8E%A5%E5%85%A5%E6%B5%81%E7%A8%8B%E6%A6%82%E8%A7%88" style="color: lightgrey; text-decoration: underline;">模型贡献文档</a>，及时完善模型卡片内容。</p>