3040 Commits (548efcd2e4fb06187a7fc18ac74f089fff175ffb)

Author	SHA1	Message	Date
Zhang Ting	548efcd2e4	Fix unit tests to avoid check_grad checking failures (#21554) ... * fix python API tests that do not need to inherit OpTest, test=develop * fix fp16 cases that will only be enabled in GPU mode, test=develop * remove TestSoftmaxFP16Op from test cases of softmax_mkldnn_op, test=develop * fix tests so that the cases are only created in GPU mode, test=develop	7 years ago
liym27	be6a639655	Add CI for checking Input/Output/Attr of modified Ops (#21522) ... * add shell scripts. test=develop * rename test_pybind_inference to test_pybind_interface and print repeat process in check_op_desc.py. test=develop * add approval RD. test=develop	7 years ago
guofei	835ea12cde	Control flow API: while_loop (#21276) ... Add basic while_loop	7 years ago
Leo Chen	4f81d1bd5f	Refine VarBase init function (#21587) ... * refine init function, test=develop * add tests, test=develop * remove extern, which may cause symbol error in gcc-4.8, test=develop	7 years ago
lijianshe02	56882ce432	change input data type and decrease max_relative_error value in test_check_grad for grop_nom_op test test=develop (#21608)	7 years ago
Huihuang Zheng	1dcf6a7212	Add Much Complex Test and Fix Bugs for Control Flow cond API (#21532) ... Add tests to use dy/dx to make sure the gradient values calculated by the control flow backward is correct. Also fixed bugs detected by those tests. Fix bugs: 1. Unlike sum_op, optimizer ops don't allow uninitialized input tensor. But in conditional_block_grad_op, since the conditional_block may not run, the output gradient tensor may be uninitialized, which will cause the optimizer op error. To fix it, we should let optimizer ops support uninitialized input like sum_op or assign the uninitialized gradient to 0 when the conditional_block_grad_op doesn't run. I found there are about 10+ optimizer ops. **To be simpler, I just assign output gradient of the conditional_block_grad_op to 0 in this PR**. But it can be further explored whether we can make optimizer ops like sum_op to support uninitialized input tensor because theoretically we can speed up without the assigning in conditional_block_grad_op. 2. Infer parameter shapes during append_backward. I didn't know that all our parameters are in global block. When op_desc is inferring shapes at the sub-block, it may not know the shape of gradients of parameters whose shape information is at global block. I fixed it by inferring shapes of gradients from forward var. This PR also did some code clean up: 1. Print the var name when sgd_op catches shape error so that it is easier to debug 2. Fix a typo: dicta -> dict	7 years ago
hutuxian	c5aec2fe68	Paddlebox Related to Framework (#21586) ... * Add a single_process_multi_thread transpiler. * Add some UTs. * Fix some API description.	7 years ago
liym27	9da7e6b4d4	add file check_op_desc.py and add interface to get default value. (#21530) ... * add file check_op_desc.py and add interface to get default value. test=develop * add test for c++ coverage rate. test=develop * Correct typo. test=develop	7 years ago
Feiyu Chan	2057df7ac0	add fluid.layers.gelu & doc (#21515) ... Add a python interface for Gelu. Add documentation for fluid.layers.gelu.	7 years ago
Jacek Czaja	9ce0e29dc3	[MKL-DNN] Batch norm mkl-dnn NHWC support (#21553) ... * - BAtch norm mkl-dnn NHWC test=develop - compilation fix test=develop - UT fix - cosmetics test=develop - Fix to Batch Norm MKL-DNN NHWC UT test=develop Conflicts: paddle/fluid/operators/batch_norm_op.h * - Lint fixes test=develop	7 years ago
hong	08483a6819	Add dygraph linear warm up decay (#21186) ... * dygraph mode support linear lr warm up; test=develop * add unitest for linear warmup; test=develop * add input type check; test=develop * fix type check assert error; test=develop * change type error; test=develop	7 years ago
lilong12	de46b15951	Unify the rank of prelu alpha to 4, corresponding to [N, C, H, W], except for the all mode	7 years ago
Leo Chen	cdd46d7e02	Split VarBase from Python Variable for Dygraph (#21359) ... * test=develop, fix docker with paddle nccl problem * don't expose numerous Tensor.set(), test=develop * fix condition, test=develop * fix float16 bug, test=develop * feed should be Tensor or np.array, not Variable or number, test=develop * use forcecast to copy numpy slice to new array, test=develop * remove float16-uint16 hacking, test=develop * add variable method to varbase and refactor to_variable to support return varbase * support kwargs in varbase constructor * add VarBase constructor to support default python args * refine varbase initial method * reset branch * fix ut for change VarBase error info to PaddleEnforce * cherry is parameter change before * overload isinstance to replace too many change of is_variable * rm useless files * rm useless code merged by git * test=develop, fix some ut failed error * test=develop, fix test_graph_wrapper * add some tests, test=develop * refine __getitem__, test=develop * add tests, test=develop * fix err_msg, test=develop	7 years ago
Youwei Song	cdba41af4d	dygraph Embedding layer use lookuptable v2 (#21209) ... * dygraph Embedding layer use lookuptable v2 test=develop * fix test_nce test=develop	7 years ago
wangchaochaohu	4c9b3dafa7	fill_constant_batch_size_like OP precious problem fix (#21337) ... * fix fill_constant_batch_size_like_op precious problem test=develop	7 years ago
Zhang Ting	b1da35261b	fix unit tests that do not need to inherit OpTest (#21460) ... * fix PythonAPI test in Op unittest, test=develop * fix unit tests that do not need to inherit OpTest, test=develop	7 years ago
WangXi	768f9242e9	Fix dgc clip & rampup step, test=develop (#21491)	7 years ago
lilong12	e75ded08a0	fix the compatiable problem between PY2 and PY3 (issue#20749) (#20942) ... * fix the compatiable problem between PY2 and PY3. * add ut, test=develop * add proxy, test=develop * download dataset before test, test=develop	7 years ago
Zeng Jinle	a3535812f6	add _use_system_allocator to some op tests, test=develop (#21504)	7 years ago
Jacek Czaja	18a5d30754	[MKL-DNN] Conv2d and Conv2d transpose MKL-DNN NHWC support (#21466)	7 years ago
zhongpu	6ebf0f47b8	support SelectedRows in dygraph, test=develop (#21078) ... * support SelectedRows in dygraph, test=develop * fix bug of _grad_ivar interface, test=develop * add optest for support seletedrows, test=develop * fix bug for gradient_accumulator in GPU mode, test=develop * fix error when Selectedrows addto LodTensor in sorted_gradient mdoe in dygraph, test=develop * refine and simplify gradient accumulator code, test=develop * add optest, test=develop * add optest and simplify code, test=develop * fix bug for test_imperative_selected_rows, test=develop * add optest for Coverage, test=develop * fix gradient interface and simplify code, test=develop * update api for gradient, test=develop * fix ShareDim's bug in DygraphExecutionContext class, test=develop * add optest, test=develop	7 years ago
lilong12	0bc8bdf724	set dim[0] to -1 if dim[0] < 0 during compiling for c_allgather op (#21402) ... * set dim[0] to -1 if dim[0] < 0 and remove assertion to runtime, test=develop * modify ENFORCE message, test=develop * add validation for x.shape[0] > 0, test=develop * add ut, test=develop	7 years ago
ruri	94bef03539	Revert "Add masked select api (#21172)" (#21456) ... This reverts commit 007c997572.	7 years ago
Zeng Jinle	87ab93af01	fix adam fp64, test=develop (#21423)	7 years ago
hutuxian	7e68bc896b	refactor AUC OP and add its CUDA Kernel (#21336) ... * refactor AUC OP and add its CUDA Kernel * the layout of global auc doesn't change	7 years ago
Zhang Ting	101240d2c1	fix PythonAPI test in Op unittest, test=develop (#21462) ... There are PythonAPI tests in Op's unittest which don't need to inherit OpTest class.	7 years ago
wawltor	dbbe6e9cb6	fix the device supported of the op unique and unique_with_counts. (#21395) ... * fix the device supported of the op unique and unique_with_counts. test=develop test=document_fix * Fix the precision of test in the op of unique and unique_with_counts. test=develop test=document_fix	7 years ago
Zhang Ting	3df13ab40c	fix PythonAPI test in Op unittest, test=develop (#21455) ... There are PythonAPI tests in Op's unittest which don't need to inherit OpTest class.	7 years ago
Jie Fang	5e813b53c5	nhwc optimization for batchnorm (#21090)	7 years ago
Chen Weihang	664f958a02	Fix optimizer op infershape failed in dygraph multi-cards mode (#21374) ... * add param & grad shape check for sgd op * add _reshape_inplece interface for dygraph parallel * refine unittest based paddle/models scripts, test=develop * add unittest for parallel grad fuse, test=develop	7 years ago
Huihuang Zheng	630be31952	Fix Cond Bug for Nested Control Flow (#21340) ... * Commit before merging develop test=develop * Backup after working with Huihuang logs * Commit before deleting Huihuang debug loggings * Commit before debug test=develop * Fix bug commit test=develop * Backup of fixing bugs test=develop * Clean up code test=develop * Fix a bug in sum_op test=develop	7 years ago
Jacek Czaja	cd43c4440e	[MKL-DNN] LRN and Pool2d (FWD) NHWC support (#21375)	7 years ago
zhaoyuchen2018	b16274556a	Add dscending for argsort (#21400) ... * Add ascending for argsort * Refine api doc description. * Refine descending description * Add int32 logic to speedup when data is small size. * Remove int32 opt as not support in python	7 years ago
hong	ac8546701d	Add dygraph execution context (#20157) ... * add_dygraph_execution_context * add dygraph infershape context and execution context; test=develop * fix imperative bug; test=develop * remove inputs outputs interface from execution context, because it have same function with inputNames; test=develop * remove tracer_test ctest; test=develop * fix split op bug; test=develop * fix unitests bug; test=develop * fix distribute test bug; test=develop * fix ngraph compile bug; test=develop * fix grad maker bug; test=develop * fix load op bugs; test=develop * fix operator.cc construct bug; test=develop * remove useless name find in operator; test=develop * add tracer_test; test=develop * fix concat, split bug; test=develop * remove tracer_test unitest; test=develop * fix attribute check bug; test=develop * add test code to fix converage; test=develop * remove useless code, change check backward input in engin; test=develop * unlock var type infer shape;test=develop * add ShareAllLoD api; test=develop * add dygraph infershape context unitest; test=develop * remove increase and decrease lod in dygraph; test=develop * addd override; test=develop * fix increase descrease lod; test=develop * fix paddle_enforce; test=develop * disable lod op dygraph check; test=develop * fix paddle enforce error; test=develop * add comment for op_registry and OperatorBase; test=develop * optimize the comment of op_registry; test=develop * fix format of comment; test=develop * fix format of comment; test=develop * optimize the format of comment; test=develop * optimize the format of the comment; test=develop * optimize comment of op_registry; test=develop	7 years ago
hutuxian	a6b089c614	add macro to ban windows (#21422) ... remove nccl related code in windows	7 years ago
Kaipeng Deng	ebfb720a63	add Adam beta1/beta2 support Variable (#21234) ... * add Adam beta1/beta2 support Variable. test=develop	7 years ago
Zeng Jinle	09696d5df8	Use system allocator in OpTest (#21335) ... * use system allocator in unittests, test=develop * fix op bugs, test=develop * fix tensor copy bug when src and dst are the same, test=develop	7 years ago
ruri	007c997572	Add masked select api (#21172)	7 years ago
Kaipeng Deng	67c836fb5c	batch_norm momentum support variable (#21246) ... * batch_norm momentum support variable. test=develop * fix format. test=develop * add batch_norm momentum variable example. test=develop * move MomentumTensor to training branch. test=develop * split example. test=develop * fix doc. test=develop * fix PADDLE_ENFORCE ci. test=develop * fix format. test=develop	7 years ago
hutuxian	47a82e38e3	Support data_norm gpu kernel (#21325) ... * support data_norm_op run in CUDA * add two parameters sync_stats & summary_decay_rate * add UT	7 years ago
Youwei Song	d5ff79e55e	Support numpy bridge (enabled by default in dygraph mode) (#20983) ... * add numpy bridge * fix template compile * add unittest, add default test=develop * fix unittest test=develop * fix unittest test=develop * zero_copy=True for to_variable, test=develop * bug fix test=develop * disable deprecated NumPy API test=develop * use better design of NumpyAllocator test=develop * fix Py_None check test=develop * reset c++ tracer when jump out dygraph guard test=develop * refine PADDLE_ENFORCE_xx format test=develop * bug fix of tracer switch test=develop * update decref test=develop	7 years ago
Michał Gallus	5d7d548275	INT8 Fully-connected (#17641) ... * Implement Int8 FC * Integrate FC into INT8v2 test=develop * int8 FC: transpose weights before computing scales test=develop * Add support for activation_type string in FC test=develop * Disable MKL-DNN's FC in VGG16 and 19 test=develop * Disable FC quantization when mkldnn FC is disabled test=develop * Solve PADDLE_ENFORCES in FC int8 * Fix Paddle enforces and remove const cast test=develop * Fix style changes test=develop * Fix quantizer_tester test and add fc quantization test=develop * Fix FC test fail on CUDA * Remove unnecessary log from quantize placement pass test=develop * Add Thread ID to FC hash key test=develop * Add comments to MKL-DNN FC Kernel test=develop * Refactor quantizer test=develop * Fix linter issues test=develop * Fix crash in slim googlenet test=develop * Fix PADDLE_ENFORCE messages test=develop	7 years ago
lilong12	41d13209d7	add the framework support for distfc (#21197) ... * add the framework support for distfc and ut, test=develop * fix the implementation of shard_index_op, test=develop	7 years ago
hong	a214a3081b	change download log format (#21290) ... * change download log formate; test=develop * add unittest for data download; test=develop * remove cache before download; test=develop	7 years ago
GaoWei8	234060f88f	Add fc padding to improve mkl GEMM's performance when N and K are multiple of 128. (#20972) ... * Add fc padding to solve mkl performance test=develop * fix gpu pass and error information test=develop * fix fc_fuse_pass_test test=develop * fix error information test=develop * fix error information test=develop * fix name and add fc op padding test test=develop * fix attributes test=develop * optimize fc padding test=develop * fix test test=develop	7 years ago
ruri	6cfcbe0510	reduce interp op input size to pass CI, test=develop (#21341)	7 years ago
Jacek Czaja	f4cf028a8c	[MKL-DNN] Error throwing for NHWC layout for MKL-DNN ops (#21207)	7 years ago
Michał Gallus	ed9ceb9f98	Refactor MKL-DNN ElementwiseMul (#21061) ... * Refactor MKL-DNN ElementwiseMul remove manual fallback, remove format attrs test=develop * Refine PADDLE_ENFORCEs in eltwise_mul_op.h test=develop * Make ElementwiseMulOp inherit from ElementwiseOp * Change type of simd_width to int test=develop * Remove Constructor extensions in ElementwiseOp and ElementwiseMulOp test=develop * Restore attributes test=develop * Fix test coverage for mkldnn eltwise mul test=develop * Conform to new is_run_common_broadcast API test=develop * Add UT for AreDimsAndFormatCorrect test=develop	7 years ago
zhaoyuchen2018	08c19c585d	Improve argsort performance. (#21267) ... * Improve argsort performance. - Give 200000 data to compute argsort on v100, can speed up ~190x before opt cost: 0.53s after opt cost:0.0027s - Add fp16 support * Refine error message * Refine code test=develop Signed-off-by: zhaoyuchen <zhaoyuchen01@baidu.com>	7 years ago
WangXi	8ac7687e36	Fix dgc accuracy by mv regularization to local (#21278)	7 years ago