58 Commits (4dc8c44ba163733eddf9edbae36b93a4f7374501)

Author	SHA1	Message	Date
zhang wenhui	7a58431c0a	fix norm api doc, test=develop (#27652) ... * fix norm api doc, test=develop * fix error message, test=develop * fix api norm, test=develop * add adagrad, test=develop * fix bug, test=develop * fix bug, test=develop * add spetral_norm, test=develop * fix adagrad, test=develop * merge , test=develop	4 years ago
ceci3	8daccc9ea7	Fix batch norm double grad compute (#27549) ... * fix bn double grad, test=develop * update, test=develop	4 years ago
ceci3	1d3b27cae8	add double grad compute for batch norm (#27296) ... * add double grad compute for batch norm,test=develop * fix unittest, test=develop * remove unuse tensor,test=develop * add format,test=develop * update, test=develop	4 years ago
ceci3	633aaea07e	Update err message (#24422) ... * update err info, test=develop * update, test=develop	5 years ago
Chen Weihang	aa0f254fbe	Add macro BOOST_GET to enrich the error information of boost :: get (#24175) ... * add new macro BOOST_GET_SAFELY & unittests, test=develop * add different macro type, test=develop * fix get macro type in executor, test=develop * four macro part change backup * using one macro for all case, test=develop * revert attribute change, test=develop * change to three func to solve gcc4.8 bug, test=develop * polish some details, test=develop	5 years ago
qingqing01	b059fb955d	Add trainable_statistics in attr for batch_norm. (#24072) ... * Add trainable_statistics in attr for batch_norm * Unifying behavior of dynamic graph and static graph	5 years ago
Kaipeng Deng	e7e7cb5f5e	Split inplace_abn & batch_norm infershape (#23755) ... * Fix elementwise compile error, test=develop * split inplace_abn & batch_norm InferShape. test=develop * fix type. test=develop * fix message. test=develop * fix ENFORCE. test=develop Co-authored-by: zhaoyuchen <zhaoyuchen01@baidu.com>	5 years ago
ceci3	cd1de0e2c5	API/OP error message enhancement (#23691) ... * error enhance,test=develop * update,test=develop * update type, test=develop * replace inout_check, test=develop	5 years ago
Kaipeng Deng	21d95be0db	Add inplace abn op (#22806) ... * add inplace_abn_op. test=develop	5 years ago
Zeng Jinle	d33c4343e1	Imperative tracer refactoring (#22457) ... * refine grad maker, test=develop * refactor tracer stage 1, test=develop * merge develop to solve conflict third times, test=develop	5 years ago
Jacek Czaja	b0b27ff699	[MKL-DNN] Conv grad and Batch Norm grad NHWC support (#22088)	5 years ago
ceci3	95d79b6d00	update error log for batch_norm_grad (#22017) ... * update error information about batch_norm_grad * update bn,test=develop	5 years ago
WangXi	17299b8d21	fix batch_norm_grad infer shape=0 & add allreduce enforce shape, test=develop (#21801)	5 years ago
Jacek Czaja	9ce0e29dc3	[MKL-DNN] Batch norm mkl-dnn NHWC support (#21553) ... * - BAtch norm mkl-dnn NHWC test=develop - compilation fix test=develop - UT fix - cosmetics test=develop - Fix to Batch Norm MKL-DNN NHWC UT test=develop Conflicts: paddle/fluid/operators/batch_norm_op.h * - Lint fixes test=develop	5 years ago
Zeng Jinle	3662fb71a7	remove eval() calls in Eigen, test=develop (#21498)	5 years ago
Jie Fang	5e813b53c5	nhwc optimization for batchnorm (#21090)	5 years ago
Leo Chen	e0c9d856fb	add unused input vars check for OpWithKernel, test=develop (#21169) ... * add unused input vars check for OpWithKernel, test=develop * remove unused vars in some ops, test=develop * fix batch_norm, test=develop * add white list, test=develop * add CI check for white list, test=develop * :ove white list to c++, test=develop * solve failure of CI, test=develop * add unittest for unused_var_check, test=develop * refine code, enable check in operator_test, test=develop * skip mkldnn, test=develop * extend white list, test=develop * refine condition of mkldnn, test=develop * fix paddle_build, test=develop * follow comments, test=develop * fix GetExpectedKernelType * add wiki ref to err_msg, test=develop * follow comment, test=develop	5 years ago
Kaipeng Deng	67c836fb5c	batch_norm momentum support variable (#21246) ... * batch_norm momentum support variable. test=develop * fix format. test=develop * add batch_norm momentum variable example. test=develop * move MomentumTensor to training branch. test=develop * split example. test=develop * fix doc. test=develop * fix PADDLE_ENFORCE ci. test=develop * fix format. test=develop	5 years ago
hong	8c4573a3cb	GradMaker for dygraph (#19706) ... * refactor dygraph,test=develop * fix failed unittest,test=develop * polish code,test=develop * check windows ci error,test=develop try to fix windows ci error by np.allclose,test=develop * polish vlog and profiler, test=develop * try to fix preceding ops order,test=develop * test transformer in windows ci, test=develop * use python c-api to speed up tracer.trace,test=develop * test=develop, fix docker with paddle nccl problem * test=develop, add ut for debug string and gradient_accumulator * test=develop, add tests for layer/gradient_accumulator/prepared_op * test=develop, fix complie error for test_prepared_op * test=develop, add more ut for dygraph * test=develop, create API.spec for dygraph api change * optimize grad maker; test=develop * optimize grad maker * test * grad make optim; test=develop * fix unittest bugs; test=develop * add dygraph grad op maker and split_op * grad op maker refactor; test=develop * add dygraph grad maker; test=develop * fix op deformable_conv_v1_op bug; test=develop * fix deformable_conv prroi pool bugs; * fix new op grad op maker bug; test=develop * fix split by ref bug; test=develop * fix dygraph auto prune bug; test=develop * fix test_trace bug; test=develop * fix fused emb seq pool bug; test=develop * remove useless code in op_desc file; test=develop * remove useless code, StrVarBaseNode; test=develop * fix review issues; test=develop * fix rank_loss grad maker; test=develop * remove flag in VarBase; test=develop * fix distributed_notify_op compile bug ; test=develop * fix reshape op double grad; test=develop * fix expand as op; test=develop * add impertive type_defs.h for demo_train; test=develop * fix inference lib cmake; test=develop * fix inference lib; test=develop * fix infernce_lib; test=develop * fix inference cmake; test=develop * fix inference lib; test=develop * fix inference lib; test=develop * remove condition dygraph grad maker, modify local name; test=develop * fix split grad maker bug; test=develop * fix pyramid_op bug; test=develop * change travis time out limit; test=develop * restore travis; test=develop * change timeout limit; test=develop	5 years ago
Chen Weihang	26cc1fe508	Replace risky GetInputType method with secure IndicateVarDataType interface (#20668) ... * replace part of the old implementation, test=develop * restore concat op, test=develop * update all ops implemention & delete GetDataTypeOfVar func, test=develop	5 years ago
lvmengsi	76ba55e891	add error log for python api and c++ (#20061) ... * add error log	5 years ago
lvmengsi	619a241bd0	Fix OpTest of bn (#19062) ... * fix bn	5 years ago
Zeng Jinle	5c8f210ce3	refine inplace inference registry, test=develop (#19032)	6 years ago
qingqing01	5fc8de449a	Remove warning in batch_norm_op (#19260)	6 years ago
Zeng Jinle	4aa931dd85	Code clean of Allocator (#17602) ... * Revert "Revert "Fix allocator bug"" This reverts commit 174d0d0b90. * Revert "fix travis ci" This reverts commit 5656fa9f7c. test=develop * add inlined_vector.h, test=develop * add inlined_vector_test,test=develop * clean code of allocator,test=develop * delete zero_size_allocator.h,test=develop * fix failed unittest,test=develop	6 years ago
Zeng Jinle	ee2028a110	Add use_cuda to inplace pass (#17205) ... * add use_cuda to inplace pass,test=develop * add test softmax_with_xe_inplace test,test=develop	6 years ago
ceci3	dd4c54cd37	test=develop	6 years ago
ceci3	55f572b2da	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into infershape	6 years ago
ceci3	87d89dfe14	fix batch_norm and cos_sim infer shape, test=develop	6 years ago
liuwei1031	8d22bc17a4	Memory optimize (#16410) ... * fix cdn issue, test=develop * fix memory optimize bugs, test=develop * fix memory optimize bugs, test=develop * remove add/sub_2 op, test=develop * disable memory_optimize by default, test=develop * disable inplace activation in python, test=develop * fix unittests, test=develop * fix unittests, test=develop * bug-fix, test=develop	6 years ago
qingqing01	8ad672a287	Support sync batch norm. (#16121) ... * Support Sync Batch Norm. * Note, do not enable it in one device. Usage: build_strategy = fluid.BuildStrategy() build_strategy.sync_batch_norm = True binary = fluid.compiler.CompiledProgram(tp).with_data_parallel( loss_name=loss_mean.name, build_strategy=build_strategy)	6 years ago
dzhwinter	4f01de6378	Merge remote-tracking branch 'origin/develop' into feature/ir_inplace_pass	6 years ago
dzhwinter	46a6cac91f	fix batch norm. test=develop (#15597)	6 years ago
dzhwinter	8f3b252392	squash commits. test=develop	6 years ago
Yu Yang	9bd70a1e04	Change tensor uses proto::VarType::type ... test=develop	6 years ago
qingqing01	731d45a39a	Enable BatchNorm to use global mean and variane during training (#14630) ... * Enable BatchNorm to use global mean and variane during training * Update doc and follow comments.	6 years ago
Sylwester Fraczek	8a1eeec579	add mkldnn prop_kind phase for inference-only case to pooling and activations (#14278) ... * add is_test to pooling and activations add prop_kind support for layers activation. conv and pooling add a pass that sets is_test to true add transpiler version of is_test pass test=develop * patch test and pass test=develop * add pass to analyzer.h test=develop * add is_test attr description & pass only on mkldnn in: activation_op.cc batch_norm_op.cc conv_op.cc dropout_op.cc lrn_op.cc pool_op.cc sequence_pool_op.cc softmax_op.cc * fix is_test handling for activation pool and conv * change description of is_test for all layers again * remove GetAttr(use_mkldnn) from pass * rename correct_mkldnn_test_phase to is_test and remove dependency on MKLDNN test=develop * review fix magic number * two if(..)s into one * Check is_test once and pass mkldnn forward prop kind * dereference shared_ptr with * (without get()) test=develop * add is_test_pass back test=develop	6 years ago
chengduo	6c6e638550	Add InferVarType for some op (#14201) ... * add_infer_var_type test=develop * InferVarTypeHelper-> VarTypeInferenceHelper test=develop * PassInputTypeAndDTypeOnOutput test=develop * follow comment test=develop	6 years ago
Xin Pan	8f2116d8fa	clean up after the changes have been stopped for so long. ... test=develop	6 years ago
guochaorong	b1fc238694	Revert "Disable in_place in batch_norm API. (#12736)" ... This reverts commit f5d5d7b2d9.	7 years ago
qingqing01	f5d5d7b2d9	Disable in_place in batch_norm API. (#12736) ... * Disable in_place in batch_norm API.	7 years ago
qingqing01	10fbb831ed	Skip BatchNorm when feature only has 1 element. (#11578) ... * Fix batch norm when only 1 elements in normzalize dimension during training.	7 years ago
pzelazko-intel	9a15c92317	bnorm+relu fuse for mkldnn (inference) (#11434) ... * bnorm+relu fuse for mkldnn * separate fuse_relu function * bug fix * proper while range in inference_transpiler * description fix * review fix * review fix * unit test for fwd batch norm+relu MKLDNN fuse	7 years ago
Luo Tao	5aac910b89	add url of cuda9.0_cudnn7_avx_mkl library	7 years ago
tensor-tang	489f581d49	Merge pull request #11098 from mozga-intel/mozga-intel/Batch_norm_mkldnn_layout ... MKLDNN layout: Support for batch norm operator	7 years ago
dzhwinter	bfa3fd6f15	add inplace attribute to op_proto_maker (#10665) ... * "add inplace attribute" * "register inplace attribute" * "change se-next model for memory-reuse" * "fix typo" * repick * fix merge conflict * "fix stupid error"	7 years ago
mozga-intel	7d5643562f	MKLDNN layout: Support for batch norm operator	7 years ago
mozga-intel	3ff9ba0e6b	Mkldnn layout (#11040) ... * Add MKLDNN layout support in Paddle Add MKLDNN layout in Paddle so that MKLDNN friendly memory layout can be used in MKLDNN enabled OP kernel. Before this commit, NCHW is hardcode to be used in all MKLDNN op kernels. As a result, non-optimized execution path is selected in MKLDNN primitive which bring worse performance. Besides framework change, three MKLDNN OP kernels were updated for using new MKLDNN layout. They are conv/pool2d/batch_norm. Other MKLDNN OP kernels need be also updated in similar way to achieve best performance. * Add MKLDNN layout support in activation OP * Don't populate layout from input to output when kMKLDNN in * Refine pool mkldnn op kernel * MKLDNN layout * Remove the inferitance from tensor file * MKLDNN layout: refactoring * Remove additional #define to register new operator * Prepare mkldnn tests to work with layout	7 years ago
Yu Yang	0e78cb69fb	Clean OpProtoAndCheckerMaker ... Do not use ctor * Reduce line of codes. * We can use virtual function for Maker now. * The implementation does not care what maker holds, it is easier to refactor later.	7 years ago
Tomasz Patejko	4a497b826d	MKLDNN implementation of batch normalization (#9904) ... * Initial implementation of forward pass for MKLDNN batch norm * Added attributes for MKLDNN batch norm * MKLDNN batch norm forward pass passes unittest. Started working on backward * Backward pass for MKLDNN batch norm added * MKLDNN batch norm: scoring added to forward pass * MKLDNN batch norm: bias as input added; handling AnyLayout when kernel is looked up * MKLDNN batch norm: python unit tests added; mkldnn tests removed * MKLDNN batch norm: changes required by cpplint * MKLDNN batch norm: refactoring the operator * MKLDNN batch norm: saved variance inversed in backward pass for correct execution of MKLDNN unit tests * MKLDNN batch norm: refctoring, function for static/const cast to void* added * MKLDNN batch norm: remove AnyLayout from batch norm * MKLDNN batch norm: only NCHW format is supported. Unittests refactored * MKDNN batch norm: use_mkldnn added to attributes * MKLDNN batch norm: AnyLayout removed from unittest * MKLDNN batch norm: added CUDNN defines to batch norm * MKLDNN batch norm: undefined data_format variable corrected * MKLDNN batch norm: use_cudnn added, use of setUp method for configuring attributes * MKLDNN batch norm: added use_cudnn attribute to batch norm operator * MKLDNN batch norm: correcting batch norm unit tests for MKLDNN * MKLDNN batch norm: MKLDNN tests moved to another file; reverting changes for saved variance not being inverted * Change default layout to NCHW * MKLDNN batch norm: init_kernel_type method added to unit tests * MKLDNN batch norm: style changes * MKLDNN batch norm: unit tests refactored * MKLDNN batch norm: added use_mkldnn attribute to batch norm python interface	7 years ago