光合开发者社区-论坛

DeepSeek

K100-AI跑Deepseek-V4实测

2026-04-24 20:04:40

1550

https://modelscope.cn/models/FlagRelease/DeepSeek-V4-Flash-hygon-FlagOS/summary docker pull harbor.baai.ac.cn/flagrelease-public/flagrelease-hygon-release-model\_hygon-new-gems-tree-tree\_0.5.0\_hcu3.0-gems\_5.0.1rc0-cx\_none-python\_3.10.12-torch\_2.9.0\_das.opt1.dtk2604.20260206.g275d08c2-gpu\_hygon001-arc\_amd64-driver\_6.3.31-v1.5.0a:2026042410131 export NCCL\_SOCKET\_IFNAME=eno1 export NCCL\_IB\_DISABLE=1 export NCCL\_DEBUG=INFO export USE\_FLAGGEMS=1 export NCCL\_DEBUG=WARN export GEMS\_VENDOR=hygon docker run \\ --name flagos \\ --network=host \\ --ipc=host \\ --device=/dev/kfd \\ --device=/dev/mkfd \\ --device=/dev/dri \\ -v /opt/hyhal:/opt/hyhal \\ -v /baai:/baai \\ --group-add video \\ --cap-add=SYS\_PTRACE \\ --security-opt seccomp=unconfined \\ -itd \\ harbor.baai.ac.cn/flagrelease-public/flagrelease-hygon-release-model\_hygon-new-gems-tree-tree\_0.5.0\_hcu3.0-gems\_5.0.1rc0-cx\_none-python\_3.10.12-torch\_2.9.0\_das.opt1.dtk2604.20260206.g275d08c2-gpu\_hygon001-arc\_amd64-driver\_6.3.31-v1.5.0a:2026042410131 cd /workspace bash run\_node0.sh bash run\_node1.sh # The reasoning answers are DCD

用新的镜像继续测试
镜像拉取:

docker run \

--name flagos \

--network=host \

--ipc=host \

--device=/dev/kfd \

--device=/dev/mkfd \

--device=/dev/dri \

-v /opt/hyhal:/opt/hyhal \

-v /baai:/baai \

--group-add video \

--cap-add=SYS_PTRACE \

--security-opt seccomp=unconfined \

-itd \

harbor.baai.ac.cn/flagrelease-public/flagrelease-hygon-release-model_hygon-new-gems-tree-tree_0.5.0_hcu3.0-gems_5.0.1rc0-cx_none-python_3.10.12-torch_2.9.0_das.opt1.dtk2604.20260206.g275d08c2-gpu_hygon001-arc_amd64-driver_6.3.31-v1.5.0a:202604242039

docker exec -it flagos /bin/bash

主节点配置：
cat /home/models/DeepSeek-V4-FlagOS-main/run_node0.sh

#!/bin/bash

# TCP 控制面

export NCCL_SOCKET_IFNAME=ens1f0np0

# RDMA 数据面

export NCCL_IB_DISABLE=0

export NCCL_IB_HCA=mlx5_0

export NCCL_IB_GID_INDEX=3

export NCCL_DEBUG=WARN # 避免过多日志，但保留警告

export USE_FLAGGEMS=1

export GEMS_VENDOR=hygon

CMD="torchrun --nproc-per-node=8 --nnodes=2 --node-rank=0 --master-addr=172.16.88.1 --master-port=29500 generate_dir.py --ckpt-path /home/models/DeepSeek-V4-Flash-hygon-FlagOS/ --config config_flash_v4.json --interactive"

exec ${CMD}

echo "主节点已启动"

从节点配置：

cat /home/models/DeepSeek-V4-FlagOS-main/run_node1.sh