Paddle

Commit Graph

Author	SHA1	Message	Date
Chen Weihang	dec53a9c79	Remove DataParallel.scale_loss & apply_collective_grads (#27603 ) * remove data parallel scale loss & apply collective_grads * move apply in minimize * fix failed unittests	6 years ago
MRXLT	1f36d3cdcb	update optimizer (#26711 ) * update doc * update doc * fix optimizer sample code * add default value for adamw weight_decay * fix adamw * change LearningRateDecay to _LRScheduler * fix adamw;notest * fix load;notest * remove file * bug fix * fix code style * bug fix * add ut * adamw support weight_decay=0 * fix ut * fix set_lr doc * fix doc * change parameters place	6 years ago
MRXLT	eeda90d674	[WIP] update optimizer for 2.0 (#26288 ) refine Optimizer/Adam/Admax/RMSProp && add Admw * buf fix * update comment * unify arguments place; notest * fix ut, test=develop * bug fix * fix conflicts, test=develop * add examples code * bug fix * fix comments * fix sample code * add sample code for Optimizer * add adamax ut, test=develop * fix rmsprop ut, test=develop * add ut for optimizer.py and adamw.py * remove TestAdamOptimizerBetaVariable * update api && add ut * update doc && fix ut * add ut Co-authored-by: mapingshuo <mps2012@yeah.net>	6 years ago

Author

SHA1

Message

Date

Chen Weihang

dec53a9c79

Remove DataParallel.scale_loss & apply_collective_grads (#27603 )

* remove data parallel scale loss & apply collective_grads

* move apply in minimize

* fix failed unittests

MRXLT

1f36d3cdcb

update optimizer (#26711 )

* update doc

* update doc

* fix optimizer sample code

* add default value for adamw weight_decay

* fix adamw

* change LearningRateDecay to _LRScheduler

* fix adamw;notest

* fix load;notest

* remove file

* bug fix

* fix code style

* bug fix

* add ut

* adamw support weight_decay=0

* fix ut

* fix set_lr doc

* fix doc

* change parameters place

MRXLT

eeda90d674

[WIP] update optimizer for 2.0 (#26288 )

refine Optimizer/Adam/Admax/RMSProp && add Admw

* buf fix

* update comment

* unify arguments place; notest

* fix ut, test=develop

* bug fix

* fix conflicts, test=develop

* add examples code

* bug fix

* fix comments

* fix sample code

* add sample code for Optimizer

* add adamax ut, test=develop

* fix rmsprop ut, test=develop

* add ut for optimizer.py and adamw.py

* remove TestAdamOptimizerBetaVariable

* update api && add ut

* update doc && fix ut

* add ut

Co-authored-by: mapingshuo <mps2012@yeah.net>

3 Commits (5132f5129dfd008b8da1e8ba4eaeffc8d8093d2c)