Skip to content

Allow bf16 Adam moments with fp32 master weights - #9106

Draft
pengdurice wants to merge 1 commit into
deepspeedai:masterfrom
pengdurice:peng-add-fused-adam-bf16-moments-fp32-master-v1
Draft

pengdurice wants to merge 1 commit into
deepspeedai:masterfrom
pengdurice:peng-add-fused-adam-bf16-moments-fp32-master-v1