13 Commits (develop)

Author	SHA1	Message	Date
huangxu96	b96dada4f0	add static.amp into setup.pu.in (#29621) ... * add static.amp into setup.pu.in * add unittest for api	5 years ago
Leo Chen	71d6220772	Skip reader op in mixed_precision decorator (#28353) ... * skip reader op in mixed_precision decorator * add ut	5 years ago
pangyoki	827ac36faa	Use dygraph mode by default (#27443) ... * default open dygraph mode * fix CI-Mac * fix Mac-CI other unittest file * fix CI-Py3 * fix test_communicator_geo and test_buffer_shared_memory_reuse_pass * add enable_static to fix CI-Py3 * add enable_static to fix CI-coverage * delete try except	6 years ago
tianshuo78520a	433cef03e5	fix typo word (#22784)	6 years ago
gongweibao	3255fe69bb	Add custom black variable name set in amp interface. (#20875) ... * add custom black varname test=develop * fix dtype test=develop * fix num test=develop * fix ut test=develop * fix coverage test=develop * fix blackvar names test=develop	7 years ago
gongweibao	1d82025e89	Add interface so user can get scaled loss when they use customized loss. (#20571)	7 years ago
Jie Fang	d9db94d752	Optimize amp for multi-gpu to enable FP16 gradients transfer across gpus. (#19714) ... Optimize amp for multi-gpu to enable FP16 gradients transfer across gpus	7 years ago
gongweibao	6c2bc29cc0	Fix float16 optimizer. (#19682) ... Fix float16 optimizer	7 years ago
Jie Fang	c6a598a276	init new amp, optimize inserting cast op for batchnorm (#18596) ... init new amp, optimize inserting cast op for batchnorm	7 years ago
Tao Luo	2f8c7e021f	remove unused inference_transpiler unit-tests (#19130) ... * remove unused inference_transpiler unit-tests test=develop * remove InferenceTranspiler usage in quantize_transpiler.py test=develop	7 years ago
Yibing Liu	f9796b1249	Add LAMB Optimizer support (#17489) ... * Add LAMB optimizer * Expose LAMB Optimizer's APIs test=develop, test=document_preview * Cleanup code & doc test=develop, test=document_preview * Update lamb optimizer's formula test=develop	7 years ago
Jie Fang	30e178fa2c	init auto loss scaling (#17194) ... * init auto loss scaling test=develop * change API.spec * change ifelse to switch and use reduce_sum to optimize checking isfinite test=develop * Remove redundant code test=develop	7 years ago
Yibing Liu	beda78258f	Init mixed precision training interface (#16856) ... * Init mixed precision training interface * Add fp16 test script test=develop * All initializers support float16 test=develop * Code cleanup & add more code annotations test=develop * Update API spec test=develop * Add usage example in doc test=develop	7 years ago