3 Commits (8a39e5c110f4a514b0740c75dc541db48973e96d)

Author	SHA1	Message	Date
Yibing Liu	f9796b1249	Add LAMB Optimizer support (#17489) ... * Add LAMB optimizer * Expose LAMB Optimizer's APIs test=develop, test=document_preview * Cleanup code & doc test=develop, test=document_preview * Update lamb optimizer's formula test=develop	7 years ago
Jie Fang	30e178fa2c	init auto loss scaling (#17194) ... * init auto loss scaling test=develop * change API.spec * change ifelse to switch and use reduce_sum to optimize checking isfinite test=develop * Remove redundant code test=develop	7 years ago
Yibing Liu	beda78258f	Init mixed precision training interface (#16856) ... * Init mixed precision training interface * Add fp16 test script test=develop * All initializers support float16 test=develop * Code cleanup & add more code annotations test=develop * Update API spec test=develop * Add usage example in doc test=develop	7 years ago