Paddle

Author	SHA1	Message	Date
kavyasrinet	35420cdf63	Updating the Latex equation for Adagrad (#6009 ) * Updating the Latex equation for Adagrad * Fixing Latex euqations for adadelta, adam and adamax	7 years ago
Yu Yang	a5e73f9eaf	Support many data types of several operators (#5731 ) * Support many data types of several operators * SeqConv only support float/double * Revert adagrad	8 years ago
kavyasrinet	30a85204b4	Adding the doc format for AdaDelta, AdaMax, Adam, AdaGrad, BatchNorm, Clip, Cast and AUC (#5317 ) * Adding the doc format for AdaDelta * Updating the documentation for Adagrad, Adam and Adamax * Updating the auc op * Fix review comments * Updating doc for Batch Norm * Updating the cast op * Updating the clip op * Fixing review comment * Fixing review comment: * Small change to restart PR_CI	8 years ago
Abhinav Arora	11bebeb2dc	Removing updates of Beta1 and Beta2 power accumulators outside the op (#4925 )	8 years ago
Yu Yang	73a8b78a72	Correct OpWithKernel's infershape (#4847 ) They are public now	8 years ago
Abhinav Arora	116800378a	Adding the Adam Optimizer operator (#4733 ) * add adam op moment1_out = beta1 * moment1 + (1 − beta1) * grad moment2_out = beta2 * moment2 + (1 − beta2) * grad * grad moment1_hat = moment1_out / (1 - beta1^t) moment2_hat = moment2_out / (1 - beta2^t) param_out = param - learning_rate * moment1_hat / (sqrt(moment2_hat) + epsilon) * fix moment 2 * Adding the Adam optimization operator * Adding more tests for Adam op	8 years ago