1
2
1
数学库
pytorch 调用dist.all_gather 结果被hold住不动了
2025-09-16 21:22:52
79
操作系统版本:例如ubuntu20.04 DTK版本:例如DTK24.04.1 驱动版本:例如rock-5.7.1-6.2.18 或者提供如下指令结果rpm -qa | grep rock DCU类型: Z100L 执行程序: import torch import torch.distributed as dist import time import sys def setup(rank, world_size): dist.init_process_group(backend='nccl', rank=rank, world_size=world_size, init_method=f'tcp://127.0.0.1:26001') torch.cuda.set_device(rank) torch.distributed.barrier() def main(rank, world_size): setup(rank, world_size) size = 2048 * 7168 // world_size tensor = torch.randn(size,).cuda() tensor_list = [torch.randn(size,).cuda() for _ in range(world_size)] ``` dist.all_gather(tensor_list, tensor) ``` if __name__ == "__main__": world_size = 2 # ▒~A~G设使▒~T▒两个 GPU torch.multiprocessing.spawn(main, args=(world_size,), nprocs=world_size, join=True) 遇到问题: ![attachmentId-image.png](/api-forum/file/Redirect?path=forum/mf4x1of65a4k/1758028772436/image.png) 程序卡住不动 ![attachmentId-image.png](/api-forum/file/Redirect?path=forum/mf4x1of65a4k/1758028840972/image.png) amd cpu上可以正常运行; intel cpu 卡住不动; 都是一个docker 镜像 py310 ![attachmentId-image.png](/api-forum/file/Redirect?path=forum/mf4x1of65a4k/1758028954453/image.png)
全部评论(1)
只看楼主
_
_mf4x1of65a4k
楼主
1楼
补充下信息 物理机和docker镜像都是ubuntu 22.04 系统+rock5.7 , hygon cpu 上也可以正常运行; 可配合
2025/9/17
没有更多内容了
--
楼主
Level.5
0 帖子
楼主热帖
暂无数据