Commit Graph

64 Commits (03d7f3ddb2504995275e929d45f51c4088b50394)

Author SHA1 Message Date
Chen Weihang 26cc1fe508
Replace risky GetInputType method with secure IndicateVarDataType interface (#20668)
6 years ago
WangXi 250e72d254 Fix DGC algorithm flow to make it the same as paper (#20758)
6 years ago
jhjiangcs 766bd529d1 add optimizer:dpsgd,test=develop (#19915)
6 years ago
Chen Weihang 8cb54ede8c
Add user-friendly error message in optimizer ops to give a hint about the position sensitive problem of run(startup_program) (#19605)
6 years ago
Tao Luo 75d1571995
refine PADDLE_ENFORCE codes for unify PADDLE_ASSERT_MSG (#19603)
6 years ago
chengduo 7453857324 Make fuse_all_reduce_op_pass support mix_precision (#17652)
6 years ago
Yibing Liu 23941e43ec
Update lamb optimizer (#18333)
6 years ago
Yibing Liu e8990e64f6
Fix trust ratio in lamb (#17614)
6 years ago
Yibing Liu f9796b1249
Add LAMB Optimizer support (#17489)
6 years ago
Qiyang Min c7f1f3ed0c
Merge pull request #16214 from velconia/imperative_infer_var_type
6 years ago
minqiyang b40e41fbd1 Polish code style
6 years ago
minqiyang ca392c7e97 Implement infer var type context
6 years ago
sneaxiy f0d108f589 fix const_cast
6 years ago
tensor-tang 14a764c930 simplify the jitkernel templates and tests
6 years ago
tensor-tang 802f362ac4 unify the kernelfuncs cache and add unit test
6 years ago
tensor-tang a0c37662b9 enable sgd jitkernel refer code and test
6 years ago
peizhilin cd562f8fb7 disable the parallel mode for adam op on windows test=develop
7 years ago
Qiao Longfei 8c516a24e5 remote min_row_size_to_use_multithread in adam interface test=develop
7 years ago
Qiao Longfei 9b4fe283e1 Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into multithread-sparse-adam
7 years ago
Qiao Longfei 44b300556d change min_row_size_to_use_multithread to parameter of adam
7 years ago
Qiao Longfei 87b4eb1da4 change min_param_size_to_use_multithread to min_row_size_to_use_multithread
7 years ago
Qiao Longfei 17b1b660fc Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into multithread-sparse-adam
7 years ago
Qiao Longfei c15270c5b2 optimize multi thread adam
7 years ago
Qiao Longfei 0e747e8d02 change the limit of thead num
7 years ago
Qiao Longfei dfe85fb358 fix build
7 years ago
Qiao Longfei f057bbd1d1 Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into fix-adam-tmp-var
7 years ago
Qiao Longfei f1c973b014 adam op should not create tmp var in compute
7 years ago
Qiao Longfei d161215332 optimize adam multi thread
7 years ago
Qiao Longfei 7a58ad5c79 lazy mode have higher priority then multithread
7 years ago
Qiao Longfei d0572bf02e add log for lazy mode test=develop
7 years ago
Qiao Longfei 1177b0bc84 update multi thread adam
7 years ago
Qiao Longfei 3b294e2e2e Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into multithread-sparse-adam
7 years ago
sneaxiy dde3afe7b7 Merge develop
7 years ago
Wu Yi 856f0da0fe
Fp16 training (#14992)
7 years ago
minqiyang 8b6b0da062 Use adam_update
7 years ago
minqiyang f4e7a47381 Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into accelerate_adam
7 years ago
sneaxiy c1f7e54f62 merge develop
7 years ago
typhoonzero da87f7a698 Revert "[Feature] Fp16 training for resnet50 (#14850)"
7 years ago
Qiao Longfei d76bda50c4 Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into multithread-sparse-adam
7 years ago
minqiyang 6467eda534 Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into accelerate_adam
7 years ago
Wu Yi 3d750f9c5a
[Feature] Fp16 training for resnet50 (#14850)
7 years ago
sneaxiy 74a8e6b032 merge develop
7 years ago
sneaxiy ae6f46a1a9 rewrite variable type
7 years ago
Qiao Longfei e2d56561e7
Merge pull request #14889 from jacquesqiao/optimize-adam
7 years ago
Qiao Longfei e0df9f2346 merge lazy mode
7 years ago
Qiao Longfei 8936c7913b add log test=develop
7 years ago
Qiao Longfei 59cf96ec18 add log
7 years ago
Qiao Longfei fe3995d335 refine code test=develop
7 years ago
Qiao Longfei fd152289fa clean for range in test=develop
7 years ago
Qiao Longfei 1141db8114 update test_adam_op
7 years ago