1
基础环境
标题
2024-09-19 09:40:05
137

python版本3.10.12
torch:2.1.0+git00661e0.abi0.dtk2404
vllm:0.5.0+das.opt1.3e2c63a.dtk2404.torch2.1.0
出现
WARNING 09-18 17:46:14 _custom_ops.py:15] Failed to import from vllm._C with ImportError('/usr/local/lib/python3.10/site-packages/vllm/_C.abi3.so: undefined symbol: _ZN5torch3jit17parseSchemaOrNameERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEE')

报错
File "/usr/local/lib/python3.10/site-packages/vllm/model_executor/models/qwen2.py", line 430, in load_weights
ops.trans_w16_gemm(_weight, weight.data, _weight.shape[0], _weight.shape[1])
File "/usr/local/lib/python3.10/site-packages/vllm/_custom_ops.py", line 207, in trans_w16_gemm
torch.ops._C.trans_w16_gemm(dst,src,row,col)
File "/usr/local/lib/python3.10/site-packages/torch/_ops.py", line 761, in getattr
raise AttributeError(
AttributeError: '_OpNamespace' '_C' object has no attribute 'trans_w16_gemm'

全部评论(3)
只看楼主
Z
zhuwenwen
2楼
建议使用镜像:docker pull image.sourcefind.cn:5000/dcu/admin/base/pytorch:2.1.0-ubuntu22.04-dtk24.04.2-py3.10
2024/10/21
网
网友xQ7Rwo
1楼
老师好,首先排查一下是否是安装包的问题,wget一下https://download.sourcefind.cn:65024/directlink/4/vllm/DAS1.0/vllm-0.3.3+das1.0+git3380931.abi0.dtk2404.torch2.1-cp310-cp310-manylinux2014_x86_64.whl,然后安装一下,老师可以先重新安装试下
2024/9/19
网
网友AeINgW
回复 @网友xQ7Rwo
以及解决了。torch和vllm版本不匹配
2024/9/19
没有更多内容了
--
楼主
Level.1
0 帖子
楼主热帖
暂无数据