1
数学库
提问帖
有回复
千问3.6-35B-A3B-FP8支持吗
2026-05-14 10:29:16
272
量化版的支持部署吗 我的是海光AI100
全部评论(7)
只看楼主
潜水1号
2楼
https://developer.sourcefind.cn/codes/modelzoo/qwen3.6
5/14
Z
zjf
回复 @潜水1号
attachmentId-image.png这个不是量化版本啊


5/14
潜水1号
回复 @zjf
对 可以先走bf16 K100AI的QWEN3.6目前还在优化中
5/15
潜水1号
1楼
K100AI不支持FP8  您是否接受其他量化方式?
5/14
Z
zjf
回复 @潜水1号
有什么量化方式


5/14
Z
zjf
回复 @潜水1号
有下载链接吗?
5/14
Z
zjf
回复 @潜水1号
我下载的这个用不了:(base) root@opcuser:/data2/models/Qwen3.6-35B-A3B-FP8# ls

chat_template.jinja layers-23.safetensors layers-4.safetensors

config.json layers-24.safetensors layers-5.safetensors

configuration.json layers-25.safetensors layers-6.safetensors

generation_config.json layers-26.safetensors layers-7.safetensors

layers-0.safetensors layers-27.safetensors layers-8.safetensors

layers-10.safetensors layers-28.safetensors layers-9.safetensors

layers-11.safetensors layers-29.safetensors LICENSE

layers-12.safetensors layers-2.safetensors merges.txt

layers-13.safetensors layers-30.safetensors model.safetensors.index.json

layers-14.safetensors layers-31.safetensors mtp.safetensors

layers-15.safetensors layers-32.safetensors outside.safetensors

layers-16.safetensors layers-33.safetensors preprocessor_config.json

layers-17.safetensors layers-34.safetensors README.md

layers-18.safetensors layers-35.safetensors tokenizer_config.json

layers-19.safetensors layers-36.safetensors tokenizer.json

layers-1.safetensors layers-37.safetensors video_preprocessor_config.json

layers-20.safetensors layers-38.safetensors vocab.json

layers-21.safetensors layers-39.safetensors

layers-22.safetensors layers-3.safetensors


5/14
没有更多内容了
--
楼主
Level.1
0 帖子
楼主热帖
暂无数据