1
Qwen
新人贴
vllm0.9.2运行qwen3-tts-12hz-1.7b-customvoice时,出现以下错误vllm: error: unrecognized arguments: --omni
2026-03-30 23:37:32
273
一、运行环境: 1、kylin v10 sp3 x86,海光k100_ai dcu, 2、docker Version: 20.10.24 3、gpustack: v2.1.0 4、K100_AI 驱动:rock-6.3.16-V1.1.0c.run 5、DTK:DTK-25.04.2-Kylinv10SP3-x86_64.tar.gz 二、问题 vllm运行Qwen3-TTS-12Hz-1.7B-CustomVoice时,报如下错误,请问是什么原因,能否提供解决方法或思路。 2026-03-30 23:25:36.942439+08:00 - gpustack.worker.backends.base - INFO - Preparing model files... 2026-03-30 23:25:36.947244+08:00 - gpustack.worker.backends.base - INFO - Model files are ready. 2026-03-30 23:25:36.947339+08:00 - gpustack.worker.serve\_manager - INFO - Provisioning model instance qwen3-tts-12hz-1.7b-customvoice-gHmMH 2026-03-30 23:25:36.947381+08:00 - gpustack.worker.backends.vllm - INFO - Starting vLLM model instance: qwen3-tts-12hz-1.7b-customvoice-gHmMH 2026-03-30 23:25:36.947701+08:00 - gpustack.worker.backends.vllm - INFO - Creating vLLM container workload: qwen3-tts-12hz-1.7b-customvoice-gHmMH 2026-03-30 23:25:36.947766+08:00 - gpustack.worker.backends.vllm - INFO - With image: harbor.sourcefind.cn:5443/dcu/admin/base/vllm:0.9.2-ubuntu22.04-dtk25.04.2-1226-das1.7-py3.10-20251226, command: [], arguments: [vllm serve /var/lib/gpustack/models/Qwen3-TTS-12Hz-1.7B-CustomVoice --omni --host 172.16.156.19 --port 40008 --served-model-name qwen3-tts-12hz-1.7b-customvoice], ports: [40008], envs(inconsistent input items mean unchangeable): OMP\_NUM\_THREADS=1 RUNAI\_STREAMER\_LOG\_LEVEL=INFO RUNAI\_STREAMER\_LOG\_TO\_STDERR=1 RUNAI\_STREAMER\_MEMORY\_LIMIT=0 SAFETENSORS\_FAST\_GPU=1 2026-03-30 23:25:36.973836+08:00 - 3821 - gpustack\_runtime.deployer.docker - INFO - Mirrored deployment enabled, using self Container dfa7f6698f39 for options mirroring 2026-03-30 23:25:37.402462+08:00 - gpustack.worker.backends.vllm - INFO - Created vLLM container workload: qwen3-tts-12hz-1.7b-customvoice-gHmMH 2026-03-30 23:25:37.402731+08:00 - gpustack.worker.serve\_manager - INFO - Finished provisioning model instance qwen3-tts-12hz-1.7b-customvoice-gHmMH \_ \_\_\_\_ \_\_ \_\_ \_\_\_ | | / / / / / / |/ / | | / / / / / / /|\_/ / | |/ / /\_\_\_/ /\_\_\_/ / / / |\_\_\_/\_\_\_\_\_/\_\_\_\_\_/\_/ /\_/ DTK version 25.04.2 vllm version 0.9.2 [32m8[0m DCU were detected in the container. [31mNOTE:[0m Make sure the user is in the 39 group. For more information, please go to https://developer.sourcefind.cn/ INFO 03-30 23:25:41 [\_\_init\_\_.py:245] Automatically detected platform rocm. usage: vllm [-h] [-v] {chat,complete,serve,bench,collect-env,run-batch} ... vllm: error: unrecognized arguments: --omni
全部评论(9)
只看楼主
D
dang
3楼
最终vllm-omni 0.15.0版本   在enforce-eager模式下跑还是太慢了,生成15秒音频需要推理40秒左右
4/9
G
gj
楼主
2楼
 image: harbor.sourcefind.cn:5443/dcu/admin/base/vllm:0.9.2-ubuntu22.04-dtk25.04.2-1226-das1.7-py3.10-20251226, command: [], arguments: [vllm serve /var/lib/gpustack/models/Qwen3-TTS-12Hz-1.7B-CustomVoice --omni --host 172.16.156.19 --port 40008 --served-model-name qwen3-tts-12hz-1.7b-customvoice],
3/31
M
mjglmvuid0dt
回复 @gj
您好,vllm-omni正在优化适配中,应该近期会支持
4/2
H
huoyongjin
回复 @gj
您好!可以更换镜像harbor.sourcefind.cn:5443/dcu/admin/base/custom:vllm0.15.1-ubuntu22.04-dtk26.04-0130-py3.10-20260220,然后拉取das源码:git clone http://developer.sourcefind.cn/codes/OpenDAS/vllm-omni.git,进入目录构建依赖pip install -e . --no-build-isolation、pip install pycountry,最后启动服务即可。
4/3
D
dang
回复 @huoyongjin
报错 No module named 'torchaudio', 能提供下对应版本的torchaudio  ,仓库里我看最新的才torchaudio-2.5.1+das.opt1.dtk25042-cp311-cp311-manylinux_2_28_x86_64.whl   但是docker镜像里的torch 已经是 2.9.0 版本了
4/8
全部6条回复
M
mjglmvuid0dt
1楼
方便发下具体的服务启动指令以及部署参考文档吗?看着错误是命令行参数未被识别
3/31
没有更多内容了
--
楼主
Level.1
0 帖子
楼主热帖
暂无数据