Paddle

Commit Graph

Author	SHA1	Message	Date
mapingshuo	3e2a348886	add string variable support for RecomputeOptimizer (#25728 )	5 years ago
mapingshuo	ed72406558	add gradient Merge Optimizer (#25625 )	5 years ago
mapingshuo	6b4a51bae3	add cuda kernel for seed, test=develop (#23749 ) * add cuda kernel for seed, test=develop	6 years ago
mapingshuo	08a772cb46	fix API param bug of recompute.backward() (#22582 ) * fix API param bug of recompute.backward(), test=develop	6 years ago
zhongpu	d0f0a2520c	test Optimizer in dygraph (#21949 ) * test Optimizer in dygraph, test=develop * add optest for Optimizer in dygraph, test=develop * fix adagrad optimizer, test=develop * fix dpsgd optimizer, test=develop * fix test_optimizer.py, test=develop * fix dpsgd optimizer, this op only support cpu, test=develop * add optest for optimizer, test=develop * add description for dpsgd, test=develop * add rmsprop to white_list in unused_var_check.cc, test=develop * polish code style, test=develop * polish code style, test=develop * delete seed attribute for DpsgdOptimizer, test=develop * change testing to debugging, test=develop	6 years ago
Aurelius84	51a86d2b6b	Optimize adam speed (#21777 ) * optimize adam speed by removing _finish_update test=develop * fix SparseAdamFunctor param list test=develop * Remove scale_op in expect_list of adam_op test=develop * fix test optimizer loss assert error test=develop * fix test optimizer loss assert error test=develop * modify PADDLE_ENFORCE usage test=develop * fix op_type in lamb_op.cc test=develop * fix errors ostream format bug test=develop * add betaPowOut in ngraph op test=develop * fix ngraph::op api for gcc8 test=develop * clean code test=develop * modify struct into class test=develop * remove code of beta1Tensor in lamb_op test=develop	6 years ago
mapingshuo	e2d849b989	Dropout with seed (#21590 ) * add seed op	6 years ago
mapingshuo	90be481b13	RecomputeOptimizer: rm unused ckpt and sort ckpt (#20108 ) * rm unused ckpt and sort ckpt * use max op idx to sort, test=develop * remove unsed code,test=develop * add testcase, test_develop * modify test case, test=develop	6 years ago
jhjiangcs	766bd529d1	add optimizer:dpsgd,test=develop (#19915 )	6 years ago
mapingshuo	9901f69677	Forward recompute3 (#19913 ) * add recompute based checkpoints methods for large batch training test=develop * add append_backward_with_forward_recomputation test=develop * refine optimizer test=develop * update backward and optimizer test=develop * make Variable usable test=develop * add recompute code * refine optimizer test=develop * refine addup _append_backward_ops_with_checkpoints_ 1) for recompute part, just cache the grad_op_desc without appending to block 2) before appending grad_op_desc to backward part, addup_repetitive_vars, remove unused branch test=develop * make method private * add recompute strategy into DistributedStrategy test=develop * checkpoint version3 test=develop * remove some print information test=develop * remove unused sumop test=develop * try to fix recompute with graph building modules * add input names to vars should be held * add memory debug tool * backup backward * Fix bugs * add backward desc for op not in any segments * add exception info for sub_block test=develop * modify code style test=develop * modify code style test=develop * remove print functions test=develop * add API spec test=develop test=document_preview * make Recompute a child class of Optimizer test=develop test=document_preview * add API spec test=develop test=document_preview * modify API spec test=develop test=document_preview * add document for Recompute test=develop test=document_preview * change API doc of Rcompute test=develop test=document_preview * code cleaning test=develop test=document_preview * modify API spec * fix bugs when segments hold no element * add testcase for Recompute Optimizer test=develop test=document_preview * add test for apply_gradient, and code cleaning test=develop test=document_preview * add test case for load function * enable CI test=develop test=document * add test case test=develop test=document_preview * add sample code for 4 function of recompute optimizer test=develop test=document_preview	6 years ago
Zeng Jinle	078a678219	refine math_op_patch, test=develop (#19727 )	6 years ago
mapingshuo	d5ac87ec22	Lookahead optimizer (#19386 ) * Add lookahead optimizer * add unittest for lookahead optimizer test=develop * add doc string for LookaheadOptimizer test=develop test=document_preview * add API spec for lookahead test=develop test=document_preview * modify api spec test=develop test=document_preview * modified doc string * modify the test file test=develop test=document_preview * modify doc string test=develop test=document_preview	6 years ago
xuezhong	20e579ef2a	add initial_accumulator_value for adagrad test=develop	7 years ago
Wu Yi	fd85418329	[Feature] support mix precision training for resnet (#14899 ) * clip softmax for fp16 * updates * fuse xent support fp16 test=develop * wip * wip * add simple row reduce * wip fp16 accurate softmax * add accurate softmax kernel for fp16 test=develop * update test=develop * fix cpu build test=develop * update api.spec test=develop * follow comments test=develop * fix build test=develop * fix trt build test=develop * fix inference build test=develop * fix merge test=develop * update test=develop * try fix build test=develop * fix build test=develop * rename real_exp test=develop * fortest * remove hacky kernels test=develop * clean up test=develop	7 years ago
minqiyang	99d3f08920	Add print_function for all python files	7 years ago
qiaolongfei	55aea98209	update test_optimizer	8 years ago
yuyang18	5e725dc52b	Hide Optimizer methods	8 years ago
qiaolongfei	6caea45941	add TestFtrlOptimizer	8 years ago
qiaolongfei	63ab12c877	update test_optimizer	8 years ago
Yu Yang	a16ed651e9	Fix CI	8 years ago
Luo Tao	bde090a975	replace paddle.v2.fluid by paddle.fluid in tests	8 years ago
Luo Tao	b11956a0b5	move Fluid API code out of V2 API code	8 years ago

22 Commits (7c42f056e2ece4080ac1203489b9730ceb3837eb)