1
数学库
提问帖
有回复
新人贴
Z100L部署image.sourcefind.cn:5000/dcu/admin/base/vllm:0.9.2-ubuntu22.04-dtk25.04.2-das1.7-py3.10-20251203镜像跑qwen2模型报错
2025-12-30 17:39:41
145
qwen_vllm | sub_out = torch.nn.functional.scaled_dot_product_attention( qwen_vllm | ERROR 12-30 17:29:33 [engine.py:476] max(): Expected reduction dim 2 to have non-zero size. qwen_vllm | ERROR 12-30 17:29:33 [engine.py:476] Traceback (most recent call last): qwen_vllm | ERROR 12-30 17:29:33 [engine.py:476] File "/usr/local/lib/python3.10/dist-packages/vllm/engine/multiprocessing/engine.py", line 464, in run_mp_engine qwen_vllm | ERROR 12-30 17:29:33 [engine.py:476] engine = MQLLMEngine.from_vllm_config( qwen_vllm | ERROR 12-30 17:29:33 [engine.py:476] File "/usr/local/lib/python3.10/dist-packages/vllm/engine/multiprocessing/engine.py", line 139, in from_vllm_config qwen_vllm | ERROR 12-30 17:29:33 [engine.py:476] return cls( qwen_vllm | ERROR 12-30 17:29:33 [engine.py:476] File "/usr/local/lib/python3.10/dist-packages/vllm/engine/multiprocessing/engine.py", line 93, in __init__ qwen_vllm | ERROR 12-30 17:29:33 [engine.py:476] self.engine = LLMEngine(*args, **kwargs) qwen_vllm | ERROR 12-30 17:29:33 [engine.py:476] File "/usr/local/lib/python3.10/dist-packages/vllm/engine/llm_engine.py", line 276, in __init__ qwen_vllm | ERROR 12-30 17:29:33 [engine.py:476] self._initialize_kv_caches() qwen_vllm | ERROR 12-30 17:29:33 [engine.py:476] File "/usr/local/lib/python3.10/dist-packages/vllm/engine/llm_engine.py", line 424, in _initialize_kv_caches qwen_vllm | ERROR 12-30 17:29:33 [engine.py:476] self.model_executor.determine_num_available_blocks()) qwen_vllm | ERROR 12-30 17:29:33 [engine.py:476] File "/usr/local/lib/python3.10/dist-packages/vllm/executor/executor_base.py", line 104, in determine_num_available_blocks qwen_vllm | ERROR 12-30 17:29:33 [engine.py:476] results = self.collective_rpc("determine_num_available_blocks") qwen_vllm | ERROR 12-30 17:29:33 [engine.py:476] File "/usr/local/lib/python3.10/dist-packages/vllm/executor/executor_base.py", line 332, in collective_rpc qwen_vllm | ERROR 12-30 17:29:33 [engine.py:476] return self._run_workers(method, *args, **(kwargs or {})) qwen_vllm | ERROR 12-30 17:29:33 [engine.py:476] File "/usr/local/lib/python3.10/dist-packages/vllm/executor/mp_distributed_executor.py", line 186, in _run_workers qwen_vllm | ERROR 12-30 17:29:33 [engine.py:476] driver_worker_output = run_method(self.driver_worker, sent_method, qwen_vllm | ERROR 12-30 17:29:33 [engine.py:476] File "/usr/local/lib/python3.10/dist-packages/vllm/utils/__init__.py", line 2910, in run_method 这是大概的错误详情
全部评论(1)
只看楼主
土
土土
楼主
1楼
Z100L是不能用vllm镜像吗?还是什么问题
2025/12/30
没有更多内容了
--
楼主
Level.1
0 帖子
楼主热帖
暂无数据