11
34
运行时
标题
2025-05-06 17:19:33
209

Z100L使用社区镜像 vllm0.8.4-ubuntu22.04-dtk25.04-rc7-das1.5-py3.10-20250429-dev-qwen3-only 运行Qwen3报错,想问下Z100L能否支持运行Qwen3?

DTK环境为25.04

xterm-256colorxterm-256colorTraceback (most recent call last):
File "/usr/lib/python3.10/runpy.py", line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/usr/lib/python3.10/runpy.py", line 86, in _run_code
exec(code, run_globals)
File "/usr/local/lib/python3.10/dist-packages/vllm/entrypoints/openai/api_server.py", line 1121, in <module> 
uvloop.run(run_server(args))
File "/usr/local/lib/python3.10/dist-packages/uvloop/init.py", line 82, in run
return loop.run_until_complete(wrapper())
File "uvloop/loop.pyx", line 1518, in uvloop.loop.Loop.run_until_complete
File "/usr/local/lib/python3.10/dist-packages/uvloop/init.py", line 61, in wrapper
return await main
File "/usr/local/lib/python3.10/dist-packages/vllm/entrypoints/openai/api_server.py", line 1069, in run_server
async with build_async_engine_client(args) as engine_client:
File "/usr/lib/python3.10/contextlib.py", line 199, in aenter
return await anext(self.gen)
File "/usr/local/lib/python3.10/dist-packages/vllm/entrypoints/openai/api_server.py", line 146, in build_async_engine_client
async with build_async_engine_client_from_engine_args(
File "/usr/lib/python3.10/contextlib.py", line 199, in aenter
return await anext(self.gen)
File "/usr/local/lib/python3.10/dist-packages/vllm/entrypoints/openai/api_server.py", line 269, in build_async_engine_client_from_engine_args
raise RuntimeError(
RuntimeError: Engine process failed to start. See stack trace for the root cause.
root@6bdd1be8281c:/home/Qwen3# /usr/lib/python3.10/multiprocessing/resource_tracker.py:224: UserWarning: resource_tracker: There appear to be 3 leaked semaphore objects to clean up at shutdown
warnings.warn('resource_tracker: There appear to be %d '
/usr/lib/python3.10/multiprocessing/resource_tracker.py:224: UserWarning: resource_tracker: There appear to be 1 leaked shared_memory objects to clean up at shutdown
warnings.warn('resource_tracker: There appear to be %d '

全部评论(5)
只看楼主
网
网友azsvq2
2楼
z100可以使用Transformers微调或推理qwen3
2025/6/24
网
网友JODPdP
楼主
1楼
请问各位大神,我看打开这个镜像用的是vllm0.8,是因为vllm不支持0.5以上版本的原因?
2025/5/6
A
ANYA
回复 @网友JODPdP
是的,Z100L目前支持0.5.0和0.3.3版本
2025/5/7
网
网友dhkRUe
回复 @网友JODPdP
那这么说现在Z100L还不支持qwen3是吗
2025/5/27
A
ANYA
回复 @网友JODPdP
是的哈
2025/6/3
没有更多内容了
--
楼主
Level.6
0 帖子
楼主热帖
暂无数据