You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Zhen Wang be3777a50a Add pure fp16 training with master weights. (#27712) ... * add the weight decay func for the momentum op * Add the multi_precision function in Momentum Optimizer. * Make sure that the initial value of master weights are same with the fp16 weights. * add static loss scaling. * add the rescale_grad function in the pure fp16 training. * use the original momentum updating method. * Polish some codes, such as variable names. * add docstring for apis. * update the var creation details of _create_master_weight. * not modify codes about imperative momentum updating. * Fix the error of test_dist_sparse_tensor_load_momentum UT. * add unit test for multi precision fp16 training. * add more unit tests for CI. * Use lower threshold values for allclose comparing in test_multi_precision_fp16_train UT. * For CI Coverage Checking.		6 years ago
..
CMakeLists.txt	Add pure fp16 training with master weights. (#27712)	6 years ago
test_correlation.py	Use dygraph mode by default (#27443)	6 years ago
test_distributed_reader.py	set default python3,fix incompatible,cache dir for third party,unify error code,for windows (#26178)	6 years ago
test_fp16_utils.py	Use dygraph mode by default (#27443)	6 years ago
test_image_classification_fp16.py	Skip reader op in mixed_precision decorator (#28353)	6 years ago
test_multi_precision_fp16_train.py	Add pure fp16 training with master weights. (#27712)	6 years ago
test_quantize_transpiler.py	Use dygraph mode by default (#27443)	6 years ago
test_weight_decay_extend.py	Fix test_weight_decay_extend random failed on windows (#28643)	6 years ago