Commit Graph

15 Commits (test_model_benchmark)

Author SHA1 Message Date
Zhen Wang 71acde9afc
Use correct master weights in AdamW. (#30895)
5 years ago
WangXi 7a0a576e51
fix adamw lr_to_coeff is fixed when dygraph (#30526)
5 years ago
Zhen Wang 7f7dfccf20
Support pure fp16 training for AMP API. (#29544)
5 years ago
WangXi 619c62bb48
fix adamw apply gradient (#30130)
5 years ago
Chen Long af37285870
fix code bugs (#29932)
5 years ago
Leo Chen a4b9daf97c
fix optimizer dtype (#29917)
5 years ago
ShenLiang e2d01eb650
Support dynamic graph distributed (#28997)
5 years ago
Leo Chen 3815d7aa40
Upgrade string literals to raw string (#28989)
5 years ago
Guo Sheng a3bc3bcd48
Fix scaled_params append error in AdamW. (#28633)
5 years ago
Guo Sheng b96869bc31
Fix lr setting of AdamW when lr is an instance of LRScheduler (#28300)
5 years ago
Zhou Wei e122e16456
fix english doc, unittest, and remove useless alias of 2.0 lr_scheduler (#27686)
6 years ago
MRXLT 84d8e49de8
refine adam/strided_slice && fix doc for rmsprop/unstack (#27740)
6 years ago
Chen Weihang dec53a9c79
Remove DataParallel.scale_loss & apply_collective_grads (#27603)
6 years ago
MRXLT 1f36d3cdcb
update optimizer (#26711)
6 years ago
MRXLT eeda90d674
[WIP] update optimizer for 2.0 (#26288)
6 years ago