如何使用VLLM发布Qwen2.5-VL?
如题参考的https://sourcefind.cn/#/model-zoo/1896814890439540737教程,那么VLLM的版本要用哪个?
1、ValueError: Model architectures ['Qwen2_5_VLForConditionalGeneration'] are not supported for now
1、ValueError: Model architectures ['Qwen2_5_VLForConditionalGeneration'] are not supported for now
2、assert "factor" in rope_scaling