7 Commits (836ee3b0c86dfcd609ab3e12a13554b9291cfc3c)

Author	SHA1	Message	Date
Chen Weihang	dec53a9c79	Remove DataParallel.scale_loss & apply_collective_grads (#27603) ... * remove data parallel scale loss & apply collective_grads * move apply in minimize * fix failed unittests	4 years ago
MRXLT	72f6e566be	fix sample code (#26962)	5 years ago
Yang Zhang	6129b0e246	Revert `no_grad` changes and add new implementation (#26826)	5 years ago
MRXLT	1f36d3cdcb	update optimizer (#26711) ... * update doc * update doc * fix optimizer sample code * add default value for adamw weight_decay * fix adamw * change LearningRateDecay to _LRScheduler * fix adamw;notest * fix load;notest * remove file * bug fix * fix code style * bug fix * add ut * adamw support weight_decay=0 * fix ut * fix set_lr doc * fix doc * change parameters place	5 years ago
Zhou Wei	30aab17734	[2.0API]support 2.0 lr_scheduler for 2.0 optimizer (#26737) ... * support 2.0 lr_scheduler for 2.0 optimizer * fix unittest * fix doc * fix unittest * fix sample code, fix unittest	5 years ago
ShenLiang	33afeb315a	fix the tanh (#26657) ... * fix the tanh * fix the learning rate	5 years ago
MRXLT	eeda90d674	[WIP] update optimizer for 2.0 (#26288) ... refine Optimizer/Adam/Admax/RMSProp && add Admw * buf fix * update comment * unify arguments place; notest * fix ut, test=develop * bug fix * fix conflicts, test=develop * add examples code * bug fix * fix comments * fix sample code * add sample code for Optimizer * add adamax ut, test=develop * fix rmsprop ut, test=develop * add ut for optimizer.py and adamw.py * remove TestAdamOptimizerBetaVariable * update api && add ut * update doc && fix ut * add ut Co-authored-by: mapingshuo <mps2012@yeah.net>	5 years ago