DCU 加速卡驱动程序：rock-5.7.1-6.2.18-V1.1.2.aio.run

DCU 加速卡软件工具包：DTK-24.04.2

加速卡： K100_AI

vllm:0.5.0+das.opt1.dtk24042

vllm启动参数：
python -m vllm.entrypoints.openai.api_server
--port 9009
--model /models
--lora-modules vllm-lora=/lora
--tensor-parallel-size 1
--served-model-name vllm-model --trust-remote-code --max-model-len 4096 --enable-lora --max-lora-rank 8

报错内容如下：

[rank0]: File "/usr/local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1541, in _call_impl
[rank0]: return forward_call(*args, **kwargs)
[rank0]: File "/usr/local/lib/python3.10/site-packages/vllm/model_executor/models/qwen2.py", line 228, in forward
[rank0]: hidden_states = self.mlp(hidden_states)
[rank0]: File "/usr/local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1532, in _wrapped_call_impl
[rank0]: return self._call_impl(*args, **kwargs)
[rank0]: File "/usr/local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1541, in _call_impl
[rank0]: return forward_call(*args, **kwargs)
[rank0]: File "/usr/local/lib/python3.10/site-packages/vllm/model_executor/models/qwen2.py", line 80, in forward
[rank0]: gate_up, _ = self.gate_up_proj(x)
[rank0]: File "/usr/local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1532, in _wrapped_call_impl
[rank0]: return self._call_impl(*args, **kwargs)
[rank0]: File "/usr/local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1541, in call_impl
[rank0]: return forward_call(*args, **kwargs)
[rank0]: File "/usr/local/lib/python3.10/site-packages/vllm/lora/layers.py", line 470, in forward
[rank0]: output_parallel = self.apply(input, bias)
[rank0]: File "/usr/local/lib/python3.10/site-packages/vllm/lora/layers.py", line 600, in apply
[rank0]: _apply_lora_packed_nslice(
[rank0]: File "/usr/local/lib/python3.10/site-packages/vllm/lora/layers.py", line 129, in _apply_lora_packed_nslice
[rank0]: add_lora_slice(output, x, lora_a_stacked[slice_idx],
[rank0]: File "/usr/local/lib/python3.10/site-packages/vllm/lora/punica.py", line 196, in add_lora_slice
[rank0]: ops.dispatch_bgmv_low_level(
[rank0]: File "/usr/local/lib/python3.10/site-packages/vllm/_custom_ops.py", line 580, in dispatch_bgmv_low_level
[rank0]: torch.ops._punica_C.dispatch_bgmv_low_level(
[rank0]: File "/usr/local/lib/python3.10/site-packages/torch/ops.py", line 854, in call
[rank0]: return self._op(*args, **(kwargs or {}))
[rank0]: RuntimeError: No suitable kernel. h_in=8 h_out=18944 dtype=Float out_dtype=BFloat16