错误日志:
WARNING 07-07 17:33:34 _core_ext.py:180] Failed to import from vllm._core_C with ImportError('libtorch_hip.so: cannot open shared object file: No such file or directory')
Traceback (most recent call last):
File "/opt/conda/bin/vllm", line 5, in <module>
from vllm.scripts import main
File "/opt/conda/lib/python3.10/site-packages/vllm/init.py", line 3, in <module>
from vllm.engine.arg_utils import AsyncEngineArgs, EngineArgs
File "/opt/conda/lib/python3.10/site-packages/vllm/engine/arg_utils.py", line 11, in <module>
from vllm.config import (CacheConfig, ConfigFormat, DecodingConfig,
File "/opt/conda/lib/python3.10/site-packages/vllm/config.py", line 12, in <module>
from vllm.model_executor.layers.quantization import QUANTIZATION_METHODS
File "/opt/conda/lib/python3.10/site-packages/vllm/model_executor/layers/quantization/init.py", line 3, in <module>
from vllm.model_executor.layers.quantization.aqlm import AQLMConfig
File "/opt/conda/lib/python3.10/site-packages/vllm/model_executor/layers/quantization/aqlm.py", line 11, in <module>
from vllm import _custom_ops as ops
File "/opt/conda/lib/python3.10/site-packages/vllm/_custom_ops.py", line 8, in <module>
from vllm._core_ext import ScalarType
File "/opt/conda/lib/python3.10/site-packages/vllm/_core_ext.py", line 182, in <module>
ScalarType = torch.classes._core_C.ScalarType
File "/opt/conda/lib/python3.10/site-packages/torch/_classes.py", line 13, in getattr
proxy = torch._C._get_custom_class_python_wrapper(self.name, attr)
RuntimeError: Tried to instantiate class '_core_C.ScalarType', but it does not exist! Ensure that it is registered via torch::class
dtk:24.4.3 pytorch:2.3.0 ubuntu:20.04 pytorch:2.3.0 vllm:vllm-0.6.2+das.opt3.dtk2504-cp310-cp310-manylinux_2_28_x86_64.whl

暂无数据