Paddle

History

Huihuang Zheng 1dcf6a7212 Add Much Complex Test and Fix Bugs for Control Flow cond API (#21532 ) Add tests to use dy/dx to make sure the gradient values calculated by the control flow backward is correct. Also fixed bugs detected by those tests. Fix bugs: 1. Unlike sum_op, optimizer ops don't allow uninitialized input tensor. But in conditional_block_grad_op, since the conditional_block may not run, the output gradient tensor may be uninitialized, which will cause the optimizer op error. To fix it, we should let optimizer ops support uninitialized input like sum_op or assign the uninitialized gradient to 0 when the conditional_block_grad_op doesn't run. I found there are about 10+ optimizer ops. To be simpler, I just assign output gradient of the conditional_block_grad_op to 0 in this PR. But it can be further explored whether we can make optimizer ops like sum_op to support uninitialized input tensor because theoretically we can speed up without the assigning in conditional_block_grad_op. 2. Infer parameter shapes during append_backward. I didn't know that all our parameters are in global block. When op_desc is inferring shapes at the sub-block, it may not know the shape of gradients of parameters whose shape information is at global block. I fixed it by inferring shapes of gradients from forward var. This PR also did some code clean up: 1. Print the var name when sgd_op catches shape error so that it is easier to debug 2. Fix a typo: dicta -> dict		5 years ago
..
CMakeLists.txt	…
adadelta_op.cc	Replace risky GetInputType method with secure IndicateVarDataType interface (#20668 )	5 years ago
adadelta_op.cu	Fix Eigen macro when using GPU	6 years ago
adadelta_op.h	Add dygraph execution context (#20157 )	5 years ago
adagrad_op.cc	Replace risky GetInputType method with secure IndicateVarDataType interface (#20668 )	5 years ago
adagrad_op.cu	Fix Eigen macro when using GPU	6 years ago
adagrad_op.h	Add dygraph execution context (#20157 )	5 years ago
adam_op.cc	add Adam beta1/beta2 support Variable (#21234 )	5 years ago
adam_op.cu	Fix Eigen macro when using GPU	6 years ago
adam_op.h	Add dygraph execution context (#20157 )	5 years ago
adamax_op.cc	Replace risky GetInputType method with secure IndicateVarDataType interface (#20668 )	5 years ago
adamax_op.cu	Fix Eigen macro when using GPU	6 years ago
adamax_op.h	Add dygraph execution context (#20157 )	5 years ago
decayed_adagrad_op.cc	Replace risky GetInputType method with secure IndicateVarDataType interface (#20668 )	5 years ago
decayed_adagrad_op.cu	Fix Eigen macro when using GPU	6 years ago
decayed_adagrad_op.h	Add dygraph execution context (#20157 )	5 years ago
dgc_momentum_op.cc	Fix dgc accuracy by mv regularization to local (#21278 )	5 years ago
dgc_momentum_op.cu	Fix DGC algorithm flow to make it the same as paper (#20758 )	5 years ago
dgc_momentum_op.h	Fix dgc accuracy by mv regularization to local (#21278 )	5 years ago
dpsgd_op.cc	Replace risky GetInputType method with secure IndicateVarDataType interface (#20668 )	5 years ago
dpsgd_op.h	Add dygraph execution context (#20157 )	5 years ago
ftrl_op.cc	Replace risky GetInputType method with secure IndicateVarDataType interface (#20668 )	5 years ago
ftrl_op.cu	Fix Eigen macro when using GPU	6 years ago
ftrl_op.h	Add dygraph execution context (#20157 )	5 years ago
lamb_op.cc	Update lamb optimizer (#18333 )	6 years ago
lamb_op.cu	Add LAMB Optimizer support (#17489 )	6 years ago
lamb_op.h	Add dygraph execution context (#20157 )	5 years ago
lars_momentum_op.cc	GradMaker for dygraph (#19706 )	5 years ago
lars_momentum_op.cu	…
lars_momentum_op.h	refine PADDLE_ENFORCE codes for unify PADDLE_ASSERT_MSG (#19603 )	6 years ago
momentum_op.cc	GradMaker for dygraph (#19706 )	5 years ago
momentum_op.cu	Fp16 training (#14992 )	6 years ago
momentum_op.h	Replace risky GetInputType method with secure IndicateVarDataType interface (#20668 )	5 years ago
proximal_adagrad_op.cc	Replace risky GetInputType method with secure IndicateVarDataType interface (#20668 )	5 years ago
proximal_adagrad_op.cu	Fix Eigen macro when using GPU	6 years ago
proximal_adagrad_op.h	…
proximal_gd_op.cc	Replace risky GetInputType method with secure IndicateVarDataType interface (#20668 )	5 years ago
proximal_gd_op.cu	Fix Eigen macro when using GPU	6 years ago
proximal_gd_op.h	…
rmsprop_op.cc	…
rmsprop_op.cu	Fix Eigen macro when using GPU	6 years ago
rmsprop_op.h	fix const_cast	6 years ago
sgd_op.cc	Add Much Complex Test and Fix Bugs for Control Flow cond API (#21532 )	5 years ago
sgd_op.cu	Add dygraph execution context (#20157 )	5 years ago
sgd_op.h	Fix DGC algorithm flow to make it the same as paper (#20758 )	5 years ago