## 环境信息 物理机环境：centos 8.4 docker环境：28.0.1, build 068a01e dtk版本：dtk-25.04.1 镜像版本：image.sourcefind.cn:5000/dcu/admin/base/vllm:0.9.2-ubuntu22.04-dtk25.04.1-rc5-rocblas104381-0915-das1.6-py3.10-20250916-rc2-ds3.2 容器启动命令： ```shell docker run -it --network=host --ipc=host --shm-size=16G --device=/dev/kfd --device=/dev/mkfd --device=/dev/dri -v /opt/hyhal:/opt/hyhal -v /public/software/models/:/models -v ./vllm-start.sh:/root/vllm-start.sh --group-add video --cap-add=SYS_PTRACE --security-opt seccomp=unconfined image.sourcefind.cn:5000/dcu/admin/base/vllm:0.9.2-ubuntu22.04-dtk25.04.1-rc5-rocblas104381-0915-das1.6-py3.10-20250916-rc2-ds3.2 /bin/bash ``` vllm 服务启动命令： ```shell export VLLM_USE_V1=0 export HIP_VISIBLE_DEVICES=0,1,2,3,4,5,6,7 vllm serve /models/Qwen3-4B-Instruct-2507/ \ --served-model-name Qwen3-4B \ --gpu-memory-utilization 0.98 \ --trust-remote-code \ --max-model-len 40960 \ --max-seq-len-to-capture 8192 \ --max-num-batched-tokens 40960 \ --max_num_seqs 1000 \ --enable-chunked-prefill \ --enable-reasoning --reasoning-parser deepseek_r1 \ --enforce-eager \ --disable-custom-all-reduce ``` 测试命令： ``` curl -X POST "http://127.0.0.1:8000/v1/completions" \ -H "Content-Type: application/json" \ -d '{ "prompt": "你好呀，可以介绍下你自己嘛", "max_tokens": 128 }' ``` ## 测试结果 ### vllm日志 ```log ERROR 10-22 15:17:54 [serving_chat.py:948] Error in chat completion stream generator. ERROR 10-22 15:17:54 [serving_chat.py:948] Traceback (most recent call last): ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/entrypoints/openai/serving_chat.py", line 518, in chat_completion_stream_generator ERROR 10-22 15:17:54 [serving_chat.py:948] async for res in result_generator: ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/engine/multiprocessing/client.py", line 601, in _process_request ERROR 10-22 15:17:54 [serving_chat.py:948] raise request_output ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/entrypoints/openai/serving_chat.py", line 518, in chat_completion_stream_generator ERROR 10-22 15:17:54 [serving_chat.py:948] async for res in result_generator: ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/engine/multiprocessing/client.py", line 601, in _process_request ERROR 10-22 15:17:54 [serving_chat.py:948] raise request_output ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/entrypoints/openai/serving_chat.py", line 518, in chat_completion_stream_generator ERROR 10-22 15:17:54 [serving_chat.py:948] async for res in result_generator: ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/engine/multiprocessing/client.py", line 601, in _process_request ERROR 10-22 15:17:54 [serving_chat.py:948] raise request_output ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/entrypoints/openai/serving_chat.py", line 518, in chat_completion_stream_generator ERROR 10-22 15:17:54 [serving_chat.py:948] async for res in result_generator: ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/engine/multiprocessing/client.py", line 601, in _process_request ERROR 10-22 15:17:54 [serving_chat.py:948] raise request_output ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/entrypoints/openai/serving_chat.py", line 518, in chat_completion_stream_generator ERROR 10-22 15:17:54 [serving_chat.py:948] async for res in result_generator: ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/engine/multiprocessing/client.py", line 601, in _process_request ERROR 10-22 15:17:54 [serving_chat.py:948] raise request_output ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/entrypoints/openai/serving_chat.py", line 518, in chat_completion_stream_generator ERROR 10-22 15:17:54 [serving_chat.py:948] async for res in result_generator: ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/engine/multiprocessing/client.py", line 601, in _process_request ERROR 10-22 15:17:54 [serving_chat.py:948] raise request_output ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/entrypoints/openai/serving_chat.py", line 518, in chat_completion_stream_generator ERROR 10-22 15:17:54 [serving_chat.py:948] async for res in result_generator: ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/engine/multiprocessing/client.py", line 601, in _process_request ERROR 10-22 15:17:54 [serving_chat.py:948] raise request_output ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/entrypoints/openai/serving_chat.py", line 518, in chat_completion_stream_generator ERROR 10-22 15:17:54 [serving_chat.py:948] async for res in result_generator: ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/engine/multiprocessing/client.py", line 601, in _process_request ERROR 10-22 15:17:54 [serving_chat.py:948] raise request_output ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/entrypoints/openai/serving_chat.py", line 518, in chat_completion_stream_generator ERROR 10-22 15:17:54 [serving_chat.py:948] async for res in result_generator: ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/engine/multiprocessing/client.py", line 601, in _process_request ERROR 10-22 15:17:54 [serving_chat.py:948] raise request_output ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/entrypoints/openai/serving_chat.py", line 518, in chat_completion_stream_generator ERROR 10-22 15:17:54 [serving_chat.py:948] async for res in result_generator: ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/engine/multiprocessing/client.py", line 601, in _process_request ERROR 10-22 15:17:54 [serving_chat.py:948] raise request_output ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/entrypoints/openai/serving_chat.py", line 518, in chat_completion_stream_generator ERROR 10-22 15:17:54 [serving_chat.py:948] async for res in result_generator: ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/engine/multiprocessing/client.py", line 601, in _process_request ERROR 10-22 15:17:54 [serving_chat.py:948] raise request_output ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/entrypoints/openai/serving_chat.py", line 518, in chat_completion_stream_generator ERROR 10-22 15:17:54 [serving_chat.py:948] async for res in result_generator: ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/engine/multiprocessing/client.py", line 601, in _process_request ERROR 10-22 15:17:54 [serving_chat.py:948] raise request_output ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/entrypoints/openai/serving_chat.py", line 518, in chat_completion_stream_generator ERROR 10-22 15:17:54 [serving_chat.py:948] async for res in result_generator: ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/engine/multiprocessing/client.py", line 601, in _process_request ERROR 10-22 15:17:54 [serving_chat.py:948] raise request_output ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/entrypoints/openai/serving_chat.py", line 518, in chat_completion_stream_generator ERROR 10-22 15:17:54 [serving_chat.py:948] async for res in result_generator: ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/engine/multiprocessing/client.py", line 601, in _process_request ERROR 10-22 15:17:54 [serving_chat.py:948] raise request_output ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/entrypoints/openai/serving_chat.py", line 518, in chat_completion_stream_generator ERROR 10-22 15:17:54 [serving_chat.py:948] async for res in result_generator: ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/engine/multiprocessing/client.py", line 601, in _process_request ERROR 10-22 15:17:54 [serving_chat.py:948] raise request_output ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/entrypoints/openai/serving_chat.py", line 518, in chat_completion_stream_generator ERROR 10-22 15:17:54 [serving_chat.py:948] async for res in result_generator: ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/engine/multiprocessing/client.py", line 601, in _process_request ERROR 10-22 15:17:54 [serving_chat.py:948] raise request_output ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/entrypoints/openai/serving_chat.py", line 518, in chat_completion_stream_generator ERROR 10-22 15:17:54 [serving_chat.py:948] async for res in result_generator: ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/engine/multiprocessing/client.py", line 601, in _process_request ERROR 10-22 15:17:54 [serving_chat.py:948] raise request_output ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/entrypoints/openai/serving_chat.py", line 518, in chat_completion_stream_generator ERROR 10-22 15:17:54 [serving_chat.py:948] async for res in result_generator: ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/engine/multiprocessing/client.py", line 601, in _process_request ERROR 10-22 15:17:54 [serving_chat.py:948] raise request_output ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/entrypoints/openai/serving_chat.py", line 518, in chat_completion_stream_generator ERROR 10-22 15:17:54 [serving_chat.py:948] async for res in result_generator: ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/engine/multiprocessing/client.py", line 601, in _process_request ERROR 10-22 15:17:54 [serving_chat.py:948] raise request_output ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/entrypoints/openai/serving_chat.py", line 518, in chat_completion_stream_generator ERROR 10-22 15:17:54 [serving_chat.py:948] async for res in result_generator: ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/engine/multiprocessing/client.py", line 601, in _process_request ERROR 10-22 15:17:54 [serving_chat.py:948] raise request_output ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/entrypoints/openai/serving_chat.py", line 518, in chat_completion_stream_generator ERROR 10-22 15:17:54 [serving_chat.py:948] async for res in result_generator: ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/engine/multiprocessing/client.py", line 601, in _process_request ERROR 10-22 15:17:54 [serving_chat.py:948] raise request_output ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/entrypoints/openai/serving_chat.py", line 518, in chat_completion_stream_generator ERROR 10-22 15:17:54 [serving_chat.py:948] async for res in result_generator: ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/engine/multiprocessing/client.py", line 601, in _process_request ERROR 10-22 15:17:54 [serving_chat.py:948] raise request_output ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/entrypoints/openai/serving_chat.py", line 518, in chat_completion_stream_generator ERROR 10-22 15:17:54 [serving_chat.py:948] async for res in result_generator: ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/engine/multiprocessing/client.py", line 601, in _process_request ERROR 10-22 15:17:54 [serving_chat.py:948] raise request_output ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/entrypoints/openai/serving_chat.py", line 518, in chat_completion_stream_generator ERROR 10-22 15:17:54 [serving_chat.py:948] async for res in result_generator: ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/engine/multiprocessing/client.py", line 601, in _process_request ERROR 10-22 15:17:54 [serving_chat.py:948] raise request_output ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/entrypoints/openai/serving_chat.py", line 518, in chat_completion_stream_generator ERROR 10-22 15:17:54 [serving_chat.py:948] async for res in result_generator: ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/engine/multiprocessing/client.py", line 601, in _process_request ERROR 10-22 15:17:54 [serving_chat.py:948] raise request_output ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/entrypoints/openai/serving_chat.py", line 518, in chat_completion_stream_generator ERROR 10-22 15:17:54 [serving_chat.py:948] async for res in result_generator: ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/engine/multiprocessing/client.py", line 601, in _process_request ERROR 10-22 15:17:54 [serving_chat.py:948] raise request_output ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/entrypoints/openai/serving_chat.py", line 518, in chat_completion_stream_generator ERROR 10-22 15:17:54 [serving_chat.py:948] async for res in result_generator: ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/engine/multiprocessing/client.py", line 601, in _process_request ERROR 10-22 15:17:54 [serving_chat.py:948] raise request_output ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/entrypoints/openai/serving_chat.py", line 518, in chat_completion_stream_generator ERROR 10-22 15:17:54 [serving_chat.py:948] async for res in result_generator: ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/engine/multiprocessing/client.py", line 601, in _process_request ERROR 10-22 15:17:54 [serving_chat.py:948] raise request_output ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/entrypoints/openai/serving_chat.py", line 518, in chat_completion_stream_generator ERROR 10-22 15:17:54 [serving_chat.py:948] async for res in result_generator: ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/engine/multiprocessing/client.py", line 601, in _process_request ERROR 10-22 15:17:54 [serving_chat.py:948] raise request_output ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/entrypoints/openai/serving_chat.py", line 518, in chat_completion_stream_generator ERROR 10-22 15:17:54 [serving_chat.py:948] async for res in result_generator: ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/engine/multiprocessing/client.py", line 601, in _process_request ERROR 10-22 15:17:54 [serving_chat.py:948] raise request_output ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/entrypoints/openai/serving_chat.py", line 518, in chat_completion_stream_generator ERROR 10-22 15:17:54 [serving_chat.py:948] async for res in result_generator: ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/engine/multiprocessing/client.py", line 601, in _process_request ERROR 10-22 15:17:54 [serving_chat.py:948] raise request_output ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/entrypoints/openai/serving_chat.py", line 518, in chat_completion_stream_generator ERROR 10-22 15:17:54 [serving_chat.py:948] async for res in result_generator: ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/engine/multiprocessing/client.py", line 601, in _process_request ERROR 10-22 15:17:54 [serving_chat.py:948] raise request_output ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/entrypoints/openai/serving_chat.py", line 518, in chat_completion_stream_generator ERROR 10-22 15:17:54 [serving_chat.py:948] async for res in result_generator: ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/engine/multiprocessing/client.py", line 601, in _process_request ERROR 10-22 15:17:54 [serving_chat.py:948] raise request_output ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/entrypoints/openai/serving_chat.py", line 518, in chat_completion_stream_generator ERROR 10-22 15:17:54 [serving_chat.py:948] async for res in result_generator: ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/engine/multiprocessing/client.py", line 601, in _process_request ERROR 10-22 15:17:54 [serving_chat.py:948] raise request_output ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/entrypoints/openai/serving_chat.py", line 518, in chat_completion_stream_generator ERROR 10-22 15:17:54 [serving_chat.py:948] async for res in result_generator: ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/engine/multiprocessing/client.py", line 601, in _process_request ERROR 10-22 15:17:54 [serving_chat.py:948] raise request_output ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/entrypoints/openai/serving_chat.py", line 518, in chat_completion_stream_generator ERROR 10-22 15:17:54 [serving_chat.py:948] async for res in result_generator: ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/engine/multiprocessing/client.py", line 601, in _process_request ERROR 10-22 15:17:54 [serving_chat.py:948] raise request_output ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/entrypoints/openai/serving_chat.py", line 518, in chat_completion_stream_generator ERROR 10-22 15:17:54 [serving_chat.py:948] async for res in result_generator: ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/engine/multiprocessing/client.py", line 601, in _process_request ERROR 10-22 15:17:54 [serving_chat.py:948] raise request_output ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/entrypoints/openai/serving_chat.py", line 518, in chat_completion_stream_generator ERROR 10-22 15:17:54 [serving_chat.py:948] async for res in result_generator: ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/engine/multiprocessing/client.py", line 601, in _process_request ERROR 10-22 15:17:54 [serving_chat.py:948] raise request_output ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/entrypoints/openai/serving_chat.py", line 518, in chat_completion_stream_generator ERROR 10-22 15:17:54 [serving_chat.py:948] async for res in result_generator: ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/engine/multiprocessing/client.py", line 601, in _process_request ERROR 10-22 15:17:54 [serving_chat.py:948] raise request_output ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/entrypoints/openai/serving_chat.py", line 518, in chat_completion_stream_generator ERROR 10-22 15:17:54 [serving_chat.py:948] async for res in result_generator: ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/engine/multiprocessing/client.py", line 601, in _process_request ERROR 10-22 15:17:54 [serving_chat.py:948] raise request_output ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/entrypoints/openai/serving_chat.py", line 518, in chat_completion_stream_generator ERROR 10-22 15:17:54 [serving_chat.py:948] async for res in result_generator: ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/engine/multiprocessing/client.py", line 601, in _process_request ERROR 10-22 15:17:54 [serving_chat.py:948] raise request_output ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/entrypoints/openai/serving_chat.py", line 518, in chat_completion_stream_generator ERROR 10-22 15:17:54 [serving_chat.py:948] async for res in result_generator: ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/engine/multiprocessing/client.py", line 601, in _process_request ERROR 10-22 15:17:54 [serving_chat.py:948] raise request_output ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/entrypoints/openai/serving_chat.py", line 518, in chat_completion_stream_generator ERROR 10-22 15:17:54 [serving_chat.py:948] async for res in result_generator: ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/engine/multiprocessing/client.py", line 601, in _process_request ERROR 10-22 15:17:54 [serving_chat.py:948] raise request_output ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/entrypoints/openai/serving_chat.py", line 518, in chat_completion_stream_generator ERROR 10-22 15:17:54 [serving_chat.py:948] async for res in result_generator: ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/engine/multiprocessing/client.py", line 601, in _process_request ERROR 10-22 15:17:54 [serving_chat.py:948] raise request_output ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/entrypoints/openai/serving_chat.py", line 518, in chat_completion_stream_generator ERROR 10-22 15:17:54 [serving_chat.py:948] async for res in result_generator: ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/engine/multiprocessing/client.py", line 601, in _process_request ERROR 10-22 15:17:54 [serving_chat.py:948] raise request_output ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/entrypoints/openai/serving_chat.py", line 518, in chat_completion_stream_generator ERROR 10-22 15:17:54 [serving_chat.py:948] async for res in result_generator: ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/engine/multiprocessing/client.py", line 601, in _process_request ERROR 10-22 15:17:54 [serving_chat.py:948] raise request_output ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/entrypoints/openai/serving_chat.py", line 518, in chat_completion_stream_generator ERROR 10-22 15:17:54 [serving_chat.py:948] async for res in result_generator: ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/engine/multiprocessing/client.py", line 601, in _process_request ERROR 10-22 15:17:54 [serving_chat.py:948] raise request_output ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/entrypoints/openai/serving_chat.py", line 518, in chat_completion_stream_generator ERROR 10-22 15:17:54 [serving_chat.py:948] async for res in result_generator: ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/engine/multiprocessing/client.py", line 601, in _process_request ERROR 10-22 15:17:54 [serving_chat.py:948] raise request_output ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/entrypoints/openai/serving_chat.py", line 518, in chat_completion_stream_generator ERROR 10-22 15:17:54 [serving_chat.py:948] async for res in result_generator: ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/engine/multiprocessing/client.py", line 601, in _process_request ERROR 10-22 15:17:54 [serving_chat.py:948] raise request_output ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/entrypoints/openai/serving_chat.py", line 518, in chat_completion_stream_generator ERROR 10-22 15:17:54 [serving_chat.py:948] async for res in result_generator: ERROR 10-22 15:17:54 [serving_chat.py:948] File "/usr/local/lib/python3.10/dist-packages/vllm/engine/multiprocessing/client.py", line 601, in _process_request ERROR 10-22 15:17:54 [serving_chat.py:948] raise request_output ERROR 10-22 15:17:54 [serving_chat.py:948] vllm.engine.multiprocessing.MQEngineDeadError: Engine loop is not running. Inspect the stacktrace to find the original error: IndexError('tuple index out of range'). ``` ### curl返回结果 ```shell {"object":"error","message":"Engine loop is not running. Inspect the stacktrace to find the original error: IndexError('tuple index out of range').","type":"Internal Server Error","param":null,"code":500} ```