10 Commits (12e4be038262fcb33b089710edaed2fe62320e3d)

Author	SHA1	Message	Date
gongweibao	7b9e33972a	delete backward return list test=develop (#20294)	7 years ago
Jie Fang	d9db94d752	Optimize amp for multi-gpu to enable FP16 gradients transfer across gpus. (#19714) ... Optimize amp for multi-gpu to enable FP16 gradients transfer across gpus	7 years ago
gongweibao	6c2bc29cc0	Fix float16 optimizer. (#19682) ... Fix float16 optimizer	7 years ago
Jie Fang	c6a598a276	init new amp, optimize inserting cast op for batchnorm (#18596) ... init new amp, optimize inserting cast op for batchnorm	7 years ago
gongweibao	abaf87be2b	Change backward_guard to optimize_guard to maximize the allreduce overlap. (#19506) ... Change backward_guard to optimize_guard to maximize the allreduce overlap	7 years ago
Zeng Jinle	5dce1da680	remove reset recordio usage (#19519)	7 years ago
Jie Fang	2b4ef509ea	init custom black white list (#18377) ... test=develop	7 years ago
Jie Fang	172c2facef	init black/white lists (#17847) ... test=develop	7 years ago
Jie Fang	30e178fa2c	init auto loss scaling (#17194) ... * init auto loss scaling test=develop * change API.spec * change ifelse to switch and use reduce_sum to optimize checking isfinite test=develop * Remove redundant code test=develop	7 years ago
Yibing Liu	beda78258f	Init mixed precision training interface (#16856) ... * Init mixed precision training interface * Add fp16 test script test=develop * All initializers support float16 test=develop * Code cleanup & add more code annotations test=develop * Update API spec test=develop * Add usage example in doc test=develop	7 years ago