我们也遇到了相同的错误
在通过vllm 加载Qwen/Qwen2.5-VL-72B-Instruct 模型是报如下错误
File "/root/miniconda3/envs/vllm311/lib/python3.11/site-packages/transformers/models/auto/configuration_auto.py", line 1025, in from_pretrainedraise ValueError(ValueError: The checkpoint you are trying to load has model type `qwen2_5_vl` but Transformers does not recognize this architecture. This could be because of an issue with the checkpoint, or because your version of Transformers is out of date.问题似乎出在Transformers需要采用4.51版本,但目前vllm版本 vllm-0.6.2+das.opt3.dtk2504-cp311-cp311-manylinux_2_28_x86_64.whl 不支持45以上版本是否有解决方案

暂无数据