Paddle

Commit Graph

Author	SHA1	Message	Date
lvmengsi	619a241bd0	Fix OpTest of bn (#19062 ) * fix bn	6 years ago
Zeng Jinle	5c8f210ce3	refine inplace inference registry, test=develop (#19032 )	6 years ago
qingqing01	5fc8de449a	Remove warning in batch_norm_op (#19260 )	6 years ago
Zeng Jinle	4aa931dd85	Code clean of Allocator (#17602 ) * Revert "Revert "Fix allocator bug"" This reverts commit `174d0d0b90`. * Revert "fix travis ci" This reverts commit `5656fa9f7c`. test=develop * add inlined_vector.h, test=develop * add inlined_vector_test,test=develop * clean code of allocator,test=develop * delete zero_size_allocator.h,test=develop * fix failed unittest,test=develop	6 years ago
Zeng Jinle	ee2028a110	Add use_cuda to inplace pass (#17205 ) * add use_cuda to inplace pass,test=develop * add test softmax_with_xe_inplace test,test=develop	6 years ago
ceci3	dd4c54cd37	test=develop	6 years ago
ceci3	55f572b2da	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into infershape	6 years ago
ceci3	87d89dfe14	fix batch_norm and cos_sim infer shape, test=develop	6 years ago
liuwei1031	8d22bc17a4	Memory optimize (#16410 ) * fix cdn issue, test=develop * fix memory optimize bugs, test=develop * fix memory optimize bugs, test=develop * remove add/sub_2 op, test=develop * disable memory_optimize by default, test=develop * disable inplace activation in python, test=develop * fix unittests, test=develop * fix unittests, test=develop * bug-fix, test=develop	6 years ago
qingqing01	8ad672a287	Support sync batch norm. (#16121 ) * Support Sync Batch Norm. * Note, do not enable it in one device. Usage: build_strategy = fluid.BuildStrategy() build_strategy.sync_batch_norm = True binary = fluid.compiler.CompiledProgram(tp).with_data_parallel( loss_name=loss_mean.name, build_strategy=build_strategy)	6 years ago
dzhwinter	4f01de6378	Merge remote-tracking branch 'origin/develop' into feature/ir_inplace_pass	6 years ago
dzhwinter	46a6cac91f	fix batch norm. test=develop (#15597 )	6 years ago
dzhwinter	8f3b252392	squash commits. test=develop	6 years ago
Yu Yang	9bd70a1e04	Change tensor uses proto::VarType::type test=develop	6 years ago
qingqing01	731d45a39a	Enable BatchNorm to use global mean and variane during training (#14630 ) * Enable BatchNorm to use global mean and variane during training * Update doc and follow comments.	6 years ago
Sylwester Fraczek	8a1eeec579	add mkldnn prop_kind phase for inference-only case to pooling and activations (#14278 ) * add is_test to pooling and activations add prop_kind support for layers activation. conv and pooling add a pass that sets is_test to true add transpiler version of is_test pass test=develop * patch test and pass test=develop * add pass to analyzer.h test=develop * add is_test attr description & pass only on mkldnn in: activation_op.cc batch_norm_op.cc conv_op.cc dropout_op.cc lrn_op.cc pool_op.cc sequence_pool_op.cc softmax_op.cc * fix is_test handling for activation pool and conv * change description of is_test for all layers again * remove GetAttr(use_mkldnn) from pass * rename correct_mkldnn_test_phase to is_test and remove dependency on MKLDNN test=develop * review fix magic number * two if(..)s into one * Check is_test once and pass mkldnn forward prop kind * dereference shared_ptr with * (without get()) test=develop * add is_test_pass back test=develop	7 years ago
chengduo	6c6e638550	Add InferVarType for some op (#14201 ) * add_infer_var_type test=develop * InferVarTypeHelper-> VarTypeInferenceHelper test=develop * PassInputTypeAndDTypeOnOutput test=develop * follow comment test=develop	7 years ago
Xin Pan	8f2116d8fa	clean up after the changes have been stopped for so long. test=develop	7 years ago
guochaorong	b1fc238694	Revert "Disable in_place in batch_norm API. (#12736 )" This reverts commit `f5d5d7b2d9`.	7 years ago
qingqing01	f5d5d7b2d9	Disable in_place in batch_norm API. (#12736 ) * Disable in_place in batch_norm API.	7 years ago
qingqing01	10fbb831ed	Skip BatchNorm when feature only has 1 element. (#11578 ) * Fix batch norm when only 1 elements in normzalize dimension during training.	7 years ago
pzelazko-intel	9a15c92317	bnorm+relu fuse for mkldnn (inference) (#11434 ) * bnorm+relu fuse for mkldnn * separate fuse_relu function * bug fix * proper while range in inference_transpiler * description fix * review fix * review fix * unit test for fwd batch norm+relu MKLDNN fuse	7 years ago
Luo Tao	5aac910b89	add url of cuda9.0_cudnn7_avx_mkl library	7 years ago
tensor-tang	489f581d49	Merge pull request #11098 from mozga-intel/mozga-intel/Batch_norm_mkldnn_layout MKLDNN layout: Support for batch norm operator	7 years ago
dzhwinter	bfa3fd6f15	add inplace attribute to op_proto_maker (#10665 ) * "add inplace attribute" * "register inplace attribute" * "change se-next model for memory-reuse" * "fix typo" * repick * fix merge conflict * "fix stupid error"	7 years ago
mozga-intel	7d5643562f	MKLDNN layout: Support for batch norm operator	7 years ago
mozga-intel	3ff9ba0e6b	Mkldnn layout (#11040 ) * Add MKLDNN layout support in Paddle Add MKLDNN layout in Paddle so that MKLDNN friendly memory layout can be used in MKLDNN enabled OP kernel. Before this commit, NCHW is hardcode to be used in all MKLDNN op kernels. As a result, non-optimized execution path is selected in MKLDNN primitive which bring worse performance. Besides framework change, three MKLDNN OP kernels were updated for using new MKLDNN layout. They are conv/pool2d/batch_norm. Other MKLDNN OP kernels need be also updated in similar way to achieve best performance. * Add MKLDNN layout support in activation OP * Don't populate layout from input to output when kMKLDNN in * Refine pool mkldnn op kernel * MKLDNN layout * Remove the inferitance from tensor file * MKLDNN layout: refactoring * Remove additional #define to register new operator * Prepare mkldnn tests to work with layout	7 years ago
Yu Yang	0e78cb69fb	Clean OpProtoAndCheckerMaker Do not use ctor * Reduce line of codes. * We can use virtual function for Maker now. * The implementation does not care what maker holds, it is easier to refactor later.	7 years ago
Tomasz Patejko	4a497b826d	MKLDNN implementation of batch normalization (#9904 ) * Initial implementation of forward pass for MKLDNN batch norm * Added attributes for MKLDNN batch norm * MKLDNN batch norm forward pass passes unittest. Started working on backward * Backward pass for MKLDNN batch norm added * MKLDNN batch norm: scoring added to forward pass * MKLDNN batch norm: bias as input added; handling AnyLayout when kernel is looked up * MKLDNN batch norm: python unit tests added; mkldnn tests removed * MKLDNN batch norm: changes required by cpplint * MKLDNN batch norm: refactoring the operator * MKLDNN batch norm: saved variance inversed in backward pass for correct execution of MKLDNN unit tests * MKLDNN batch norm: refctoring, function for static/const cast to void* added * MKLDNN batch norm: remove AnyLayout from batch norm * MKLDNN batch norm: only NCHW format is supported. Unittests refactored * MKDNN batch norm: use_mkldnn added to attributes * MKLDNN batch norm: AnyLayout removed from unittest * MKLDNN batch norm: added CUDNN defines to batch norm * MKLDNN batch norm: undefined data_format variable corrected * MKLDNN batch norm: use_cudnn added, use of setUp method for configuring attributes * MKLDNN batch norm: added use_cudnn attribute to batch norm operator * MKLDNN batch norm: correcting batch norm unit tests for MKLDNN * MKLDNN batch norm: MKLDNN tests moved to another file; reverting changes for saved variance not being inverted * Change default layout to NCHW * MKLDNN batch norm: init_kernel_type method added to unit tests * MKLDNN batch norm: style changes * MKLDNN batch norm: unit tests refactored * MKLDNN batch norm: added use_mkldnn attribute to batch norm python interface	7 years ago
dzhwinter	57be5c6c74	"fix double type error" (#10322 ) * "fix double type error" * "fix ci"	7 years ago
Siddharth Goyal	cea391217a	Fix cpplint errors (#9800 )	7 years ago
Yu Yang	0760aaf440	Shrink batch_norm_grad's inputs	7 years ago
Kexin Zhao	446d54f5c3	update	7 years ago
Kexin Zhao	e870947cfd	fix batch norm fp16 param type	7 years ago
qingqing01	24509f4af9	Fix the grammar in copyright. (#8403 )	7 years ago
Yi Wang	fc374821dd	Correct #include path	7 years ago
Yi Wang	90648f336d	Move file to fluid/; Edit CMakeLists.txt	7 years ago

37 Commits (619a241bd03956f285980e36624f6968f6ba0a38)