15 Commits (1cd6721873c221d4912de839b2f3bf7600a23aaa)

Author	SHA1	Message	Date
mapingshuo	90be481b13	RecomputeOptimizer: rm unused ckpt and sort ckpt (#20108) ... * rm unused ckpt and sort ckpt * use max op idx to sort, test=develop * remove unsed code,test=develop * add testcase, test_develop * modify test case, test=develop	7 years ago
jhjiangcs	766bd529d1	add optimizer:dpsgd,test=develop (#19915)	7 years ago
mapingshuo	9901f69677	Forward recompute3 (#19913) ... * add recompute based checkpoints methods for large batch training test=develop * add append_backward_with_forward_recomputation test=develop * refine optimizer test=develop * update backward and optimizer test=develop * make Variable usable test=develop * add recompute code * refine optimizer test=develop * refine addup _append_backward_ops_with_checkpoints_ 1) for recompute part, just cache the grad_op_desc without appending to block 2) before appending grad_op_desc to backward part, addup_repetitive_vars, remove unused branch test=develop * make method private * add recompute strategy into DistributedStrategy test=develop * checkpoint version3 test=develop * remove some print information test=develop * remove unused sumop test=develop * try to fix recompute with graph building modules * add input names to vars should be held * add memory debug tool * backup backward * Fix bugs * add backward desc for op not in any segments * add exception info for sub_block test=develop * modify code style test=develop * modify code style test=develop * remove print functions test=develop * add API spec test=develop test=document_preview * make Recompute a child class of Optimizer test=develop test=document_preview * add API spec test=develop test=document_preview * modify API spec test=develop test=document_preview * add document for Recompute test=develop test=document_preview * change API doc of Rcompute test=develop test=document_preview * code cleaning test=develop test=document_preview * modify API spec * fix bugs when segments hold no element * add testcase for Recompute Optimizer test=develop test=document_preview * add test for apply_gradient, and code cleaning test=develop test=document_preview * add test case for load function * enable CI test=develop test=document * add test case test=develop test=document_preview * add sample code for 4 function of recompute optimizer test=develop test=document_preview	7 years ago
Zeng Jinle	078a678219	refine math_op_patch, test=develop (#19727)	7 years ago
mapingshuo	d5ac87ec22	Lookahead optimizer (#19386) ... * Add lookahead optimizer * add unittest for lookahead optimizer test=develop * add doc string for LookaheadOptimizer test=develop test=document_preview * add API spec for lookahead test=develop test=document_preview * modify api spec test=develop test=document_preview * modified doc string * modify the test file test=develop test=document_preview * modify doc string test=develop test=document_preview	7 years ago
xuezhong	20e579ef2a	add initial_accumulator_value for adagrad ... test=develop	7 years ago
Wu Yi	fd85418329	[Feature] support mix precision training for resnet (#14899) ... * clip softmax for fp16 * updates * fuse xent support fp16 test=develop * wip * wip * add simple row reduce * wip fp16 accurate softmax * add accurate softmax kernel for fp16 test=develop * update test=develop * fix cpu build test=develop * update api.spec test=develop * follow comments test=develop * fix build test=develop * fix trt build test=develop * fix inference build test=develop * fix merge test=develop * update test=develop * try fix build test=develop * fix build test=develop * rename real_exp test=develop * fortest * remove hacky kernels test=develop * clean up test=develop	8 years ago
minqiyang	99d3f08920	Add print_function for all python files	8 years ago
qiaolongfei	55aea98209	update test_optimizer	8 years ago
yuyang18	5e725dc52b	Hide Optimizer methods	8 years ago
qiaolongfei	6caea45941	add TestFtrlOptimizer	8 years ago
qiaolongfei	63ab12c877	update test_optimizer	8 years ago
Yu Yang	a16ed651e9	Fix CI	8 years ago
Luo Tao	bde090a975	replace paddle.v2.fluid by paddle.fluid in tests	8 years ago
Luo Tao	b11956a0b5	move Fluid API code out of V2 API code	8 years ago