/usr/local/lib/python3.10/site-packages/deepspeed/ops/adam/fused_adam.py:96: UserWarning: The torch.cuda.DtypeTensor constructors are no longer recommended. It's best to use methods such as torch.tensor(data, dtype=, device='cuda') to create tensors. (Triggered internally at /data/jenkins_workspace/workspace/pytorch@4/torch/csrc/tensor/python_tensor.cpp:83.)
self._dummy_overflow_buf = get_accelerator().IntTensor([0])
Launch params (512, 1, 1) are larger than launch bounds (256) for kernel Z25multi_tensor_apply_kernelI18TensorListMetadataILi4EE11AdamFunctorIfEJffffff10adamMode_tfEEviPViT_T0_DpT1 please add launch_bounds to kernel define or use --gpu-max-threads-per-block recompile program !
Launch params (512, 1, 1) are larger than launch bounds (256) for kernel Z25multi_tensor_apply_kernelI18TensorListMetadataILi4EE11AdamFunctorIfEJffffff10adamMode_tfEEviPViT_T0_DpT1 please add launch_bounds to kernel define or use --gpu-max-threads-per-block recompile program !
Launch params (512, 1, 1) are larger than launch bounds (256) for kernel Z25multi_tensor_apply_kernelI18TensorListMetadataILi4EE11AdamFunctorIfEJffffff10adamMode_tfEEviPViT_T0_DpT1 please add launch_bounds to kernel define or use --gpu-max-threads-per-block recompile program !