python版本3.10.12
torch:2.1.0+git00661e0.abi0.dtk2404
vllm:0.5.0+das.opt1.3e2c63a.dtk2404.torch2.1.0
出现
WARNING 09-18 17:46:14 _custom_ops.py:15] Failed to import from vllm._C with ImportError('/usr/local/lib/python3.10/site-packages/vllm/_C.abi3.so: undefined symbol: _ZN5torch3jit17parseSchemaOrNameERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEE')
报错
File "/usr/local/lib/python3.10/site-packages/vllm/model_executor/models/qwen2.py", line 430, in load_weights
ops.trans_w16_gemm(_weight, weight.data, _weight.shape[0], _weight.shape[1])
File "/usr/local/lib/python3.10/site-packages/vllm/_custom_ops.py", line 207, in trans_w16_gemm
torch.ops._C.trans_w16_gemm(dst,src,row,col)
File "/usr/local/lib/python3.10/site-packages/torch/_ops.py", line 761, in getattr
raise AttributeError(
AttributeError: '_OpNamespace' '_C' object has no attribute 'trans_w16_gemm'

暂无数据