|
|||||
|
|
Increasing Momentum-Like Factors:A Method for Reducing Training Errors on Multiple GPUs |
|
| Authors: | Yu Tang Zhigang Kan Lujia Yin Zhiquan Lai Zhaoning Zhang Linbo Qiao Dongsheng Li |
| Abstract: | In distributed training,increasing batch size can improve parallelism,but it can also bring many difficulties to the training process and cause training errors.... |
| Keywords: | |