You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Zhen Wang be3777a50a Add pure fp16 training with master weights. (#27712) ... * add the weight decay func for the momentum op * Add the multi_precision function in Momentum Optimizer. * Make sure that the initial value of master weights are same with the fp16 weights. * add static loss scaling. * add the rescale_grad function in the pure fp16 training. * use the original momentum updating method. * Polish some codes, such as variable names. * add docstring for apis. * update the var creation details of _create_master_weight. * not modify codes about imperative momentum updating. * Fix the error of test_dist_sparse_tensor_load_momentum UT. * add unit test for multi precision fp16 training. * add more unit tests for CI. * Use lower threshold values for allclose comparing in test_multi_precision_fp16_train UT. * For CI Coverage Checking.		6 years ago
..
base	fleet support paddle.optimzier (#28026)	6 years ago
collective	fleet support paddle.optimzier (#28026)	6 years ago
parameter_server	Add pure fp16 training with master weights. (#27712)	6 years ago
tests	【paddle.distributed.fleet】add data_generator in distributed.fleet.dataset (#27345)	6 years ago
utils	test=develop, rm pathlib (#28658)	6 years ago
__init__.py	Revert "Integrated API of Parameter Server (#22710)" test=develop (#23071)	6 years ago