76 Commits (f5f76e610d98894801b3c140acce06ad71bf4c97)

Author	SHA1	Message	Date
Aurelius84	2ca5801d8c	API(append_backward) error message enhancement (#23446) ... * API/OP (append_backward) error message enhancement test=develop * polish check_type test=develop * fix unittest failed test=develop * merge develop test=develop	5 years ago
Aurelius84	fab9464f84	API(fluid.gridents) error message enhancement (#23450) ... * API(fluid.gridents) error message enhancement test=develop * fix unitest failed test=develop	5 years ago
Zeng Jinle	a31d7328b7	Add dygraph double grad implementation (#22939) ... * add double grad implementation for dygraph, test=develop * polish code, add uts, test=develop * fix place bug, test=develop * polish codes, add more uts for coverages, test=develop * add no_grad_set, test=develop * add star gan ut, test=develop * follow comments, test=develop	5 years ago
Zhang Ting	3f371db82a	add op_device attr for backward op_desc, test=develop (#23062)	5 years ago
Zhang Ting	eec10aaba2	set op_device for loss_op_desc (#23027)	5 years ago
Zhang Ting	4e8bc02461	add fluid.device_guard to specify the device type for Op (#22254) ... * add fluid.device_guard to specify the device type for Op	5 years ago
tianshuo78520a	d2ba91aad1	fix typo words (#22653)	5 years ago
Guo Sheng	e7bbad6c49	Fix the leaving out of rnn_memory_helper_grad's output vars. test=develop (#22499)	5 years ago
Aurelius84	50af6b5d79	polish no_grad_set of gradient and append_backward (#22440) ... * polish backward api doc test=develop, test=document_preview, test=document_fix * polish backward api doc test=develop, test=document_preview, test=document_fix * no_grad supports set of Variable test=develop, test=document_preview * polish sample code of append_backward test=develop, test=document_preview * modify assert into Raise TypeError test=develop,test=document_preview * fix unittest failed test=develop * rm useless file test=develop * polish en doc test=develop * polish code of no_grad_set test=develop * polish code of no_grad_set test=develop	5 years ago
Zeng Jinle	039bb5050c	Polish backward.py to prune more ops (#22246) ... * polish backward prune, test=develop * fix control flow op bug, test=develop * add some unittests, test=develop * fix unittest args, test=develop * follow huihuang's comments, test=develop	5 years ago
zhangchunle	805328e13b	fix typo in error message (#22312)	5 years ago
liym27	7d8d45991a	control flow: support optimizer called (#21851) ... * append optimize op in the grad block of current block if current block is in control flow. test=develop * add conditional grad op when optimizer used in control flow. test=develop * add comment and modify typo. test=develop * fix append_backward to support control flow. test=develop * add test. test=develop * fix copy_var_to_parent_block and conditional_block_grad. test=develop * fix bug: revert to append conditional_block_grad vars to sub grad block. test=develop * fix bug: revert to assign var to parent block even if var already is in parent block * fix bug: consider outputs is empty. test=develop * move _rename_grad_ out. test=develop * modify code according to reviews from Huihuang. test=develop * modify code according to reviews from Jinle. test=develop	5 years ago
Chen Weihang	9a2204ee1f	Uniform append_backward & gradients parameter_list type to Variable (#21938) ... * update doc, test=develop * fix related unittests, test=develop * fix str incompatible error, test=develop	5 years ago
Huihuang Zheng	557bce77da	Fix Backward Bugs in Conditional Block (#21809) ... The fixed bugs: 1. The condition sub-graph is not pruned 2. When backward graph is extremely simple, the whole backward ops are pruned.	5 years ago
mapingshuo	e2d849b989	Dropout with seed (#21590) ... * add seed op	5 years ago
Huihuang Zheng	1dcf6a7212	Add Much Complex Test and Fix Bugs for Control Flow cond API (#21532) ... Add tests to use dy/dx to make sure the gradient values calculated by the control flow backward is correct. Also fixed bugs detected by those tests. Fix bugs: 1. Unlike sum_op, optimizer ops don't allow uninitialized input tensor. But in conditional_block_grad_op, since the conditional_block may not run, the output gradient tensor may be uninitialized, which will cause the optimizer op error. To fix it, we should let optimizer ops support uninitialized input like sum_op or assign the uninitialized gradient to 0 when the conditional_block_grad_op doesn't run. I found there are about 10+ optimizer ops. **To be simpler, I just assign output gradient of the conditional_block_grad_op to 0 in this PR**. But it can be further explored whether we can make optimizer ops like sum_op to support uninitialized input tensor because theoretically we can speed up without the assigning in conditional_block_grad_op. 2. Infer parameter shapes during append_backward. I didn't know that all our parameters are in global block. When op_desc is inferring shapes at the sub-block, it may not know the shape of gradients of parameters whose shape information is at global block. I fixed it by inferring shapes of gradients from forward var. This PR also did some code clean up: 1. Print the var name when sgd_op catches shape error so that it is easier to debug 2. Fix a typo: dicta -> dict	5 years ago
Huihuang Zheng	630be31952	Fix Cond Bug for Nested Control Flow (#21340) ... * Commit before merging develop test=develop * Backup after working with Huihuang logs * Commit before deleting Huihuang debug loggings * Commit before debug test=develop * Fix bug commit test=develop * Backup of fixing bugs test=develop * Clean up code test=develop * Fix a bug in sum_op test=develop	5 years ago
lvmengsi	aadd81b662	Fix gradients (#20857) ... * fix_gradients * fix_gradients, test=develop	5 years ago
Aurelius84	74a28f5ea4	fix fill_constant shape with -1 and enhance cross_entropy test=develop (#20722)	5 years ago
liym27	fc6ec3b9f6	fill_constant support Tensor; (#20521) ... 2. fix bug in backward.py: using fill_constant instead of fill_constant_batch_size_like 3. fix bug in ExpandGradOp. test=develop	5 years ago
Youwei Song	478e4d6882	polish append_backward en doc (#20199) ... * polish append_backward, test=document_fix * test=document_fix, test=develop * test=document_fix, test=develop * polish append_backward, test=document_fix, test=develop	5 years ago
mapingshuo	90be481b13	RecomputeOptimizer: rm unused ckpt and sort ckpt (#20108) ... * rm unused ckpt and sort ckpt * use max op idx to sort, test=develop * remove unsed code,test=develop * add testcase, test_develop * modify test case, test=develop	5 years ago
mapingshuo	d62360fe5f	fix doc of apply_optimize (#19965) ... * fix doc of apply_optimize test=document_fix test=document_preview * modify doc of backward test=develop test=document_fix * modify document hash test=develop test=document_preview	5 years ago
mapingshuo	9901f69677	Forward recompute3 (#19913) ... * add recompute based checkpoints methods for large batch training test=develop * add append_backward_with_forward_recomputation test=develop * refine optimizer test=develop * update backward and optimizer test=develop * make Variable usable test=develop * add recompute code * refine optimizer test=develop * refine addup _append_backward_ops_with_checkpoints_ 1) for recompute part, just cache the grad_op_desc without appending to block 2) before appending grad_op_desc to backward part, addup_repetitive_vars, remove unused branch test=develop * make method private * add recompute strategy into DistributedStrategy test=develop * checkpoint version3 test=develop * remove some print information test=develop * remove unused sumop test=develop * try to fix recompute with graph building modules * add input names to vars should be held * add memory debug tool * backup backward * Fix bugs * add backward desc for op not in any segments * add exception info for sub_block test=develop * modify code style test=develop * modify code style test=develop * remove print functions test=develop * add API spec test=develop test=document_preview * make Recompute a child class of Optimizer test=develop test=document_preview * add API spec test=develop test=document_preview * modify API spec test=develop test=document_preview * add document for Recompute test=develop test=document_preview * change API doc of Rcompute test=develop test=document_preview * code cleaning test=develop test=document_preview * modify API spec * fix bugs when segments hold no element * add testcase for Recompute Optimizer test=develop test=document_preview * add test for apply_gradient, and code cleaning test=develop test=document_preview * add test case for load function * enable CI test=develop test=document * add test case test=develop test=document_preview * add sample code for 4 function of recompute optimizer test=develop test=document_preview	5 years ago
Youwei Song	3e5fb6361b	fix api-doc error for dygraph and backward (#19721) ... * update dygraph api-doc and backward api-doc, test=develop * update dygraph api-doc and backward api-doc, update api.spec, test=develop * update dygraph api-doc and backward api-doc, update api.spec, test=develop * update API.spec, test=develop	6 years ago
chengduo	bfb6ac816e	Fix optimizer bug (#19410) ... * fix optimizer bug test=develop	6 years ago
chengduo	8259f1418f	Enhance backward process (#18700) ... * prun backward ops test=develop	6 years ago
chengduo	e0d8c6ac68	Add find_no_grad_vars in backward.py (#17942) ... * add not_been_used_vars to no_grad_set test=develop	6 years ago
xsrobin	47e2ef38e9	add "import paddle.fluid as fluid" to examples lack of it	6 years ago
qingqing01	80d2e66f9e	Update backward appending stragety to support double backward and fix some bug. (#18104) ... * Update backward.py: - If there is no input grad var in all outputs of previous ops, do not append this op into graph. - Only apply this stragety when double backward. * Update some double backward op. * Update sum_op to judge whether a tensor is empty by numel or IsInitialized().	6 years ago
Zeng Jinle	712bfb17cb	fix recurrent_op,test=develop (#17433)	6 years ago
lujun	e388a1fb66	Repair api example (#17221) ... Fix the following API examples: paddle.fluid.scope_guard paddle.fluid.backward.append_backward paddle.fluid.cpu_places paddle.fluid.cuda_pinned_places paddle.fluid.cuda_places paddle.fluid.in_dygraph_mode paddle.fluid.CUDAPlace paddle.fluid.CPUPlace paddle.fluid.CUDAPinnedPlace	6 years ago
qingqing01	c1c2633a63	Support backward of backward for Relu and add a new gradient checker by comparing theoretical and numerical Jacobian. (#16862) ... * Support backward of backward and a new gradient checker * Rename decorators.py to decorator_helper.py, since Python on Windows CI has decorators package. 1. Add ReluDoubleGradMaker when register relu_grad. 2. Add a new gradient checker by comparing theoretical and numerical Jacobian. Check double gradients by double_grad_check.	6 years ago
Zeng Jinle	1c526e1d1a	Fix some grad op desc makers (#16633) ... * fix some grad op desc maker test=develop * fix grad op desc makers test=develop	6 years ago
Xin Pan	6324032602	MLP forward backward ... test=develop	6 years ago
Xin Pan	47ea2534fb	clean parallel do ... test=develop	6 years ago
Wu Yi	16e73e0d28	hide operator API (#12543) ... * hide operator API * update * update api.spec * fix merge * fix test	6 years ago
Wu Yi	efafc72f62	Hide program APIs (#12315) ... * hide program APIs * fix merge error * update	6 years ago
minqiyang	99d3f08920	Add print_function for all python files	7 years ago
minqiyang	77f12e000f	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into port_pybind11	7 years ago
gongweibao	842fb021b3	Fix clone() bug. (#12583)	7 years ago
minqiyang	e0d5f8a820	Move compat module to python/paddle	7 years ago
minqiyang	5338417b47	Polish code style	7 years ago
minqiyang	ae39709e59	Polish code	7 years ago
minqiyang	e4057d071b	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into port_pybind11	7 years ago
minqiyang	5d4238cdcc	Fix six.iteritems problem	7 years ago
minqiyang	6dc07e7f95	Replace items() with six.moves.iteritems() to improve memory usage	7 years ago
minqiyang	bc12c2c616	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into port_python3_syntax	7 years ago
minqiyang	c3fdf3aee4	Fix divide problem in CI ... Fix pb_protobuf2 FromString problem	7 years ago
minqiyang	6abe819f07	Fix pybind11 problem ... Fix str and bytes problem Fix sorted problem Fix math problem Fix CI problem	7 years ago