1
数学库
海光vllm运行一段时间会假死
2025-04-15 12:36:10
121

镜像:

image.sourcefind.cn:5000/dcu/admin/base/pytorch:2.1.0-ubuntu20.04-dtk24.04.2-py3.10

 

报错:
[] ERROR: Exception in ASGI application
[] Traceback (most recent call last):
[] File "/usr/local/lib/python3.10/site-packages/starlette/responses.py", line 257, in call
[] await wrap(partial(self.listen_for_disconnect, receive))
[] File "/usr/local/lib/python3.10/site-packages/starlette/responses.py", line 253, in wrap
[] await func()
[] File "/usr/local/lib/python3.10/site-packages/starlette/responses.py", line 230, in listen_for_disconnect
[] message = await receive()
[] File "/usr/local/lib/python3.10/site-packages/uvicorn/protocols/http/httptools_impl.py", line 555, in receive
[] await self.message_event.wait()
[] File "/usr/local/lib/python3.10/asyncio/locks.py", line 214, in wait
[] await fut
[] asyncio.exceptions.CancelledError: Cancelled by cancel scope 7f05f7767610
[]
[] During handling of the above exception, another exception occurred:
[]
[] Traceback (most recent call last):
[] File "/usr/local/lib/python3.10/site-packages/uvicorn/protocols/http/httptools_impl.py", line 401, in run_asgi
[] result = await app( # type: ignore[func-returns-value]
[] File "/usr/local/lib/python3.10/site-packages/uvicorn/middleware/proxy_headers.py", line 70, in call
[] return await self.app(scope, receive, send)
[] File "/usr/local/lib/python3.10/site-packages/fastapi/applications.py", line 1054, in call
[] await super().call(scope, receive, send)
[] File "/usr/local/lib/python3.10/site-packages/starlette/applications.py", line 113, in call
[] await self.middleware_stack(scope, receive, send)
[] File "/usr/local/lib/python3.10/site-packages/starlette/middleware/errors.py", line 187, in call
[] raise exc
[] File "/usr/local/lib/python3.10/site-packages/starlette/middleware/errors.py", line 165, in call
[] await self.app(scope, receive, _send)
[] File "/usr/local/lib/python3.10/site-packages/starlette/middleware/cors.py", line 85, in call
[] await self.app(scope, receive, send)
[] File "/usr/local/lib/python3.10/site-packages/starlette/middleware/exceptions.py", line 62, in call
[] await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
[] File "/usr/local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 62, in wrapped_app
[] raise exc
[] File "/usr/local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 51, in wrapped_app
[] await app(scope, receive, sender)
[] File "/usr/local/lib/python3.10/site-packages/starlette/routing.py", line 715, in call
[] await self.middleware_stack(scope, receive, send)
[] File "/usr/local/lib/python3.10/site-packages/starlette/routing.py", line 735, in app
[] await route.handle(scope, receive, send)
[] File "/usr/local/lib/python3.10/site-packages/starlette/routing.py", line 288, in handle
[] await self.app(scope, receive, send)
[] File "/usr/local/lib/python3.10/site-packages/starlette/routing.py", line 76, in app
[] await wrap_app_handling_exceptions(app, request)(scope, receive, send)
[] File "/usr/local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 62, in wrapped_app
[] raise exc
[] File "/usr/local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 51, in wrapped_app
[] await app(scope, receive, sender)
[] File "/usr/local/lib/python3.10/site-packages/starlette/routing.py", line 74, in app
[] await response(scope, receive, send)
[] File "/usr/local/lib/python3.10/site-packages/starlette/responses.py", line 250, in call
[] async with anyio.create_task_group() as task_group:
[] File "/usr/local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 736, in aexit
[] raise BaseExceptionGroup(

全部评论(5)
只看楼主
W
wangs
3楼
不太确定您的驱动版本,可以查看一下该链接https://download.sourcefind.cn:65024/6/main
2025/4/16
W
wangs
2楼
可以使用最新的镜像 docker pull image.sourcefind.cn:5000/dcu/admin/base/pytorch:2.4.1-ubuntu22.04-dtk25.04-py3.10
2025/4/15
网
网友jgVyvA
回复 @wangs
驱动需要更新吗
2025/4/15
W
wangs
回复 @wangs
用DTK 25.04的驱动 https://download.sourcefind.cn:65024/6/main/dtk-25.04%E9%A9%B1%E5%8A%A8
2025/4/21
W
wangs
1楼
提供一下测试的模型以及启动命令
2025/4/15
没有更多内容了
--
楼主
Level.3
0 帖子
楼主热帖
暂无数据