14 Commits (f3818bd3358f5218e601b26c93c0a51cd015d74f)

Author	SHA1	Message	Date
QI JUN	9c25218361	create learning rate variable for every parameter (#5524) ... * create learning rate variable for every parameter * fix ci * set parameter lr relatively to global lr	8 years ago
Siddharth Goyal	2e355f032e	Fix attribute naming for momentum_op (#5453) ... * Fix attribute naming for momentum_op * Fix minor typo in comment * Fix attribute name * Fix names in test_optimizer * Fix python wrapper	8 years ago
Yu Yang	51d4afaae9	Rename program->main_program, init_program->startup_program (#5360)	8 years ago
Qiao Longfei	f48159ade0	Optimizer use init program (#5275) ... * optimizer use init_program * create persistable variable * add create_persistable_var to block * optimizer use create_persistable_var * fix prefix * move create_global_persistable_var from Block to LayerHelper * Polish Optimizer initialization code. * Using the LayerHelper to create initialize operator and variables * add_accumulator should use an independent data type * default use param data type for accumulator	8 years ago
Abhinav Arora	79c5a46194	Handling global step increment in optimizer python wrapper (#5097) ... * Adding the increment op for global step * Changing list to single op as per code review feedback	8 years ago
Abhinav Arora	8623e48ba8	Add python API for backward regularization ops (#5135) ... * Add regularizer code * Fix code	8 years ago
Abhinav Arora	f8c6dadae1	Implementing the python wrapper for Adamax optimizer (#5061)	8 years ago
Abhinav Arora	a3842494d3	Adding nesterov momentum to python momentum wrapper (#5055) ... * Adding nesterov momentum to python momentum wrapper * Fixing optimizer test after merge	8 years ago
Yu Yang	dd0008d57f	Extract apply_backward_pass to backward.py (#5026) ... * Extract apply_backward_pass to backward.py Rename apply_backward_pass to append_backward_ops * Fix CI * Update design doc	8 years ago
Abhinav Arora	d78d119346	Adding python wrapper for adam operator (#5021) ... * Adding Adam Python wrapper * Adding tests for Python Adam wrapper	8 years ago
Kexin Zhao	7256cbe1de	add default value to epsilon	8 years ago
Kexin Zhao	fdaf0772c4	add adagrad optimizer python implementation	8 years ago
Abhinav Arora	0e31d7d71b	Adding the interface for the momentum optimizer (#4919) ... * Adding the interface for the momentum optimizer * Adding a comment about accumulators	8 years ago
Qiao Longfei	df0946ebe2	Impl optimizer (#4734) ... * init parameter base class * optimize the Comments of optimizer * basic implimentation of optimizer * add test_optimizer * add no_grad_set to interface * update optimizer.py * python code can run * fix some problem * add sync_with_cpp to Python Program and Block * sync vars and ops in block from cpp * optimize code and add some comment * add more check for sync * update optimizer with return value of Backward * rm unused code * infer shape when create gradient vairiable * update test_optimizer * update test_program.py * update backward test * follow comment	8 years ago