镜像名称：jupyter-vllm0.9.2:ubuntu22.04-dtk25.04.1-829 执行命令： ```language vllm serve Qwen/Qwen3-0.6B --served-model-name Qwen3-0.6B --trust-remote-code --tensor-parallel-size 2 --dtype float16 --max-model-len 32768 --gpu-memory-utilization 0.8 --enable-prefix-caching ``` 报错信息： I0119 16:57:21.278097 770 ProcessGroupNCCL.cpp:1254] [PG ID 1 PG GUID 1 Rank 1] ProcessGroupNCCL aborts successfully. I0119 16:57:21.278146 770 ProcessGroupNCCL.cpp:1263] [PG ID 1 PG GUID 1 Rank 1] ProcessGroupNCCL destructor entered. I0119 16:57:21.278183 770 ProcessGroupNCCL.cpp:1284] [PG ID 1 PG GUID 1 Rank 1] ProcessGroupNCCL watchdog thread joined. I0119 16:57:21.278242 770 ProcessGroupNCCL.cpp:1288] [PG ID 1 PG GUID 1 Rank 1] ProcessGroupNCCL heart beat monitor thread joined. I0119 16:57:21.307057 770 ProcessGroupNCCL.cpp:1247] [PG ID 0 PG GUID 0 Rank 1] Launching ProcessGroupNCCL abort asynchrounously. I0119 16:57:21.307142 770 ProcessGroupNCCL.cpp:1133] [PG ID 0 PG GUID 0 Rank 1] future is successfully executed for: ProcessGroup abort I0119 16:57:21.307159 770 ProcessGroupNCCL.cpp:1254] [PG ID 0 PG GUID 0 Rank 1] ProcessGroupNCCL aborts successfully. I0119 16:57:21.307229 770 ProcessGroupNCCL.cpp:1263] [PG ID 0 PG GUID 0 Rank 1] ProcessGroupNCCL destructor entered. I0119 16:57:21.307268 770 ProcessGroupNCCL.cpp:1284] [PG ID 0 PG GUID 0 Rank 1] ProcessGroupNCCL watchdog thread joined. I0119 16:57:21.307291 770 ProcessGroupNCCL.cpp:1288] [PG ID 0 PG GUID 0 Rank 1] ProcessGroupNCCL heart beat monitor thread joined. ERROR 01-19 16:57:25 [multiproc_executor.py:135] Worker proc VllmWorker-1 died unexpectedly, shutting down executor. Process EngineCore_0: Traceback (most recent call last): File "/usr/lib/python3.10/multiprocessing/process.py", line 314, in _bootstrap self.run() File "/usr/lib/python3.10/multiprocessing/process.py", line 108, in run self._target(*self._args, **self._kwargs) File "/usr/local/lib/python3.10/dist-packages/vllm/v1/engine/core.py", line 590, in run_engine_core raise e File "/usr/local/lib/python3.10/dist-packages/vllm/v1/engine/core.py", line 577, in run_engine_core engine_core = EngineCoreProc(*args, **kwargs) File "/usr/local/lib/python3.10/dist-packages/vllm/v1/engine/core.py", line 404, in __init__ super().__init__(vllm_config, executor_class, log_stats, File "/usr/local/lib/python3.10/dist-packages/vllm/v1/engine/core.py", line 82, in __init__ self._initialize_kv_caches(vllm_config) File "/usr/local/lib/python3.10/dist-packages/vllm/v1/engine/core.py", line 142, in _initialize_kv_caches available_gpu_memory = self.model_executor.determine_available_memory() File "/usr/local/lib/python3.10/dist-packages/vllm/v1/executor/abstract.py", line 76, in determine_available_memory output = self.collective_rpc("determine_available_memory") File "/usr/local/lib/python3.10/dist-packages/vllm/v1/executor/multiproc_executor.py", line 215, in collective_rpc result = get_response(w, dequeue_timeout) File "/usr/local/lib/python3.10/dist-packages/vllm/v1/executor/multiproc_executor.py", line 202, in get_response raise RuntimeError( RuntimeError: Worker failed with error 'backend='' raised: RuntimeError: PassManager::run failed Set TORCH_LOGS="+dynamo" and TORCHDYNAMO_VERBOSE=1 for more information You can suppress this exception and fall back to eager by setting: import torch._dynamo torch._dynamo.config.suppress_errors = True ', please check the stack trace above for the root cause Traceback (most recent call last): File "/usr/local/bin/vllm", line 8, in sys.exit(main()) File "/usr/local/lib/python3.10/dist-packages/vllm/entrypoints/cli/main.py", line 65, in main args.dispatch_function(args) File "/usr/local/lib/python3.10/dist-packages/vllm/entrypoints/cli/serve.py", line 55, in cmd uvloop.run(run_server(args)) File "/usr/local/lib/python3.10/dist-packages/uvloop/__init__.py", line 82, in run return loop.run_until_complete(wrapper()) File "uvloop/loop.pyx", line 1518, in uvloop.loop.Loop.run_until_complete File "/usr/local/lib/python3.10/dist-packages/uvloop/__init__.py", line 61, in wrapper return await main File "/usr/local/lib/python3.10/dist-packages/vllm/entrypoints/openai/api_server.py", line 1431, in run_server await run_server_worker(listen_address, sock, args, **uvicorn_kwargs) File "/usr/local/lib/python3.10/dist-packages/vllm/entrypoints/openai/api_server.py", line 1451, in run_server_worker async with build_async_engine_client(args, client_config) as engine_client: File "/usr/lib/python3.10/contextlib.py", line 199, in __aenter__ return await anext(self.gen) File "/usr/local/lib/python3.10/dist-packages/vllm/entrypoints/openai/api_server.py", line 158, in build_async_engine_client async with build_async_engine_client_from_engine_args( File "/usr/lib/python3.10/contextlib.py", line 199, in __aenter__ return await anext(self.gen) File "/usr/local/lib/python3.10/dist-packages/vllm/entrypoints/openai/api_server.py", line 194, in build_async_engine_client_from_engine_args async_llm = AsyncLLM.from_vllm_config( File "/usr/local/lib/python3.10/dist-packages/vllm/v1/engine/async_llm.py", line 162, in from_vllm_config return cls( File "/usr/local/lib/python3.10/dist-packages/vllm/v1/engine/async_llm.py", line 124, in __init__ self.engine_core = EngineCoreClient.make_async_mp_client( File "/usr/local/lib/python3.10/dist-packages/vllm/v1/engine/core_client.py", line 96, in make_async_mp_client return AsyncMPClient(*client_args) File "/usr/local/lib/python3.10/dist-packages/vllm/v1/engine/core_client.py", line 666, in __init__ super().__init__( File "/usr/local/lib/python3.10/dist-packages/vllm/v1/engine/core_client.py", line 403, in __init__ with launch_core_engines(vllm_config, executor_class, File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/usr/local/lib/python3.10/dist-packages/vllm/v1/engine/utils.py", line 434, in launch_core_engines wait_for_engine_startup( File "/usr/local/lib/python3.10/dist-packages/vllm/v1/engine/utils.py", line 484, in wait_for_engine_startup raise RuntimeError("Engine core initialization failed. " RuntimeError: Engine core initialization failed. See root cause above. Failed core proc(s): {'EngineCore_0': 1} root@worker-0:~# /usr/lib/python3.10/multiprocessing/resource_tracker.py:224: UserWarning: resource_tracker: There appear to be 1 leaked semaphore objects to clean up at shutdown warnings.warn('resource_tracker: There appear to be %d ' /usr/lib/python3.10/multiprocessing/resource_tracker.py:224: UserWarning: resource_tracker: There appear to be 2 leaked shared_memory objects to clean up at shutdown warnings.warn('resource_tracker: There appear to be %d '