1271 Commits (e58619295e82b86795da6d29587a17a3efdc486a)

Author	SHA1	Message	Date
石晓伟	ddb9b46fec	change the function in op_teller, test=develop (#22794) ... * change the function in op_teller, test=develop * correct the commit-id, test=develop	5 years ago
liu zhengxi	324f2b3922	Fix inference c api PD_GetZeroCopyOutput lod (#22768) ... * fix inference c api lod, test=develop * fix capi lod problem and enrich tests, test=develop * delete useless header files and alter const_cast, test=develop	5 years ago
tianshuo78520a	433cef03e5	fix typo word (#22784)	5 years ago
liu zhengxi	71ab0458e1	Fix pointer and c-api encapsulation (#22663) ... * refine pointer and c-api prototype, test=develop * fix new c api profile bug, test=develop * add unit tests, test=develop	5 years ago
GaoWei8	cdf5f6fb8c	Add an inference interface to disable FC padding (#22097) ... * Add an interface of disabling FC padding * fix bert regression * polish fc padding interface * recover pass function * fix argument error * fix mkldnn error	5 years ago
tianshuo78520a	d2ba91aad1	fix typo words (#22653)	5 years ago
flame	d97475d53b	fix CPU C inference API compile bug (#22702)	5 years ago
flame	74eb82de19	fix go api bug (#22669)	5 years ago
flame	f7eafca828	remove python inference warning (#22602)	5 years ago
flame	1d503e6a9e	Golang inference API (#22503) ... * support golang inference	5 years ago
Zhaolong Xing	8acd745c25	[Ernie GPU Optim]: Fuse three fc to multihtead matmul (#22486) ... * 1. optim multihead matmul: fuse three fc to multihtead matmul test=develop * fix conflict test=develop * fix comments test=develop	5 years ago
Wojciech Uss	4cddb43c5c	Add support for Ernie NLP model to the Slim QAT (#22506) ... * a test for Ernie QAT INT8 accuracy check test=develop * Remove NLP comparison test to split PRs test=develop * Fix typo and tabs, delete commented lines test=develop * re-combine the 2 PRs, test=develop Co-authored-by: Michał Gallus <sand3r@interia.eu> Co-authored-by: bingyanghuang <33643817+bingyanghuang@users.noreply.github.com>	5 years ago
Zhaolong Xing	54a325a52f	[Refine Paddle-TRT INT8]: Support PaddleSlim's Resnet50, Mobilenetv1, Yolov3 models for Inference. (#22483) ... * add int8 op teller for trt. * refine trt int8 * add int8 op teller for trt. test=develop	5 years ago
Zhaolong Xing	ceda0b9b1a	[Fix BUG]: Core when multi thread + clone + paddle-trt (#22442) ... * add mutex for trt engine test=develop * add the test for copy_to_cpu test=develop	5 years ago
石晓伟	e1b0d7cbb1	remove anakin from code, test=develop (#22420)	5 years ago
joanna.wozna.intel	3099d9d47c	Restore requantize squash (#22399)	5 years ago
石晓伟	8cb04664b9	revert paddle_fluid.map, test=develop (#22236)	5 years ago
liu zhengxi	07afc29e90	Make api.cc malloc consistent with paddle_api.h for PaddleBuf (#22255)	5 years ago
silingtong123	4f1da4adcb	remove the useless third_party library from C++ inference library (#22021) ... * remove the useless third_party library from C++ inference library * revert removing the install directory	5 years ago
zhouwei25	549e6de7ac	faster build by reduce by-product, reduce linking library and fix compile warning of std=c++11 (#22164)	5 years ago
Wilber	1230c110cb	[fluid-lite] adjust to relative error (#22232) ... - fluid和lite精度比较替换为相对误差	5 years ago
Wojciech Uss	2e90c4eb0a	improve mkldnn_quantizer_config test code coverage (#22216)	5 years ago
Wilber	5750152e80	support fluid-lite subgraph run resnet test=develop (#22191) ... - 添加了fluid-lite子图方式运行resnet的单测 - 修改了依赖Lite的git commit id	5 years ago
石晓伟	ad0dfb17c1	[Feature] Lite subgraph (#22114)	5 years ago
Pei Yang	d8a9b134e3	fix trt instance_norm serialize bug. test=develop (#22152)	5 years ago
Yiqun Liu	b1401fb74d	Remove subgraph_detector from inference/analysis to the common framework/ir directory. (#22094) ... test=develop	5 years ago
Pei Yang	50bee83f71	add TRT support for instance_norm op (#21928) ... * add TRT support for instance_norm op	5 years ago
Pei Yang	0a51098a71	Add TRT support for BERT (#21135) ... * add gelu plugin * align trt bert with gpu * add support for fused fc with relu, * add unittest for bert trt	5 years ago
Michał Gallus	6192108408	[DNNL] 3D Fully-Connected (#21746)	5 years ago
zhouwei25	e66f92d1ae	Modify demo_ci to support Windows, prepare for PR_Windows_Inference (#21873)	5 years ago
石晓伟	03479469a7	fix multi-thread error of fc_gru_fuse_pass.cc, test=develop (#21841) ... * fix multi-thread error of fc_gru_fuse_pass.cc, test=develop * export FLAGS and GLOG symbols, test=develop	5 years ago
lidanqing	9dff56e8e2	change qat_performance with mobilenet, change batch_size of qat2_resnet50 (#21895) ... test=develop	5 years ago
Michał Gallus	253e664275	Disable memory opt pass when DNNL is on (#21826) ... * Disable memory opt pass when DNNL is on * Refine comment above mem optimization pass enablement test=develop	5 years ago
Michał Gallus	a5159d8480	Re-anble vgg and resnet101 models download (#21713) ... test=develop	5 years ago
石晓伟	2bb135825e	fix analysis_predictor when func is called multiple times, test=release/1.6 (#21665)	5 years ago
Chen Weihang	1fd1f06f11	Rename paddle throw error macro (#21657) ... * rename paddle throw error macro, test=develop * fix new error use case, test=develop	5 years ago
joanna.wozna.intel	d419b859c0	Add reshape int8 mkldnn op (#21428) ... * Add reshape int8 op test=develop * Change test to CPUPlace test=develop * Correct tests test=develop	5 years ago
Zhaolong Xing	fbbd94a6ce	there is bug for inference using auto grwoth allocator (#21621) ... test=develop	5 years ago
Adam	e81f0228df	MKL-DNN 1.0 Update (#20162) ... * MKLDNN v1.0 rebase to Paddle 1.6 test=develop * Add hacky paddle::string::to_string() implementation * vectorize<int64-t>() -> vectorize() cleanup test=develop * PADDLE_ENFORCE and void_cast fixes test=develop * Rebase changes test=develop * Cosmetics test=develop * Delete MKL from mkldnn.cmake test=develop * CMake debug commands test=develop * Delete MKLDNN_VERBOSE and rebase fixes test=develop * Rebase fixes test=develop * Temporarily disable int8 resnet101 vgg16 and vgg19 tests test=develop * Add libmkldnn.so.1 to python setup test=develop * Add libmkldnn.so.1 to inference_lib cmake after rebase test=develop * Post rebase fixes + FC int8 changes test=develop * Fix LRN NHWC test=develop * Fix NHWC conv3d test=develop * Windows build fix + next conv3d fix test=develop * Fix conv2d on AVX2 machines test=develop	5 years ago
rensilin	7f5d532a9c	fix: fail to call ZeroCopyTensor::mutable_data() when device_id is no… (#21461) ... * ZeroCopyTensor::mutable_data in the right device, test=develop * add unittest for zerocopy, test=develop	5 years ago
lidanqing	fbf9eca0d3	QAT Int8 document (#21360) ... * update benchmark for int8v2, QAT1, QAT2 accuracy and performance test=document_fix * change according to reviews test=develop test=document_fix * improve some descriptions and some models test=develop test=document_fix * update models benchmark data test=develop test=document_fix * update int8v2 and qat2 performance test=develop test=document_fix	5 years ago
Pei Yang	20d61414b4	fix glog warning, test=develop (#21573)	5 years ago
Pei Yang	122b37ce62	make config option DisableGlogInfo() able to mute all inference logs (#21318) ... * make DisableGlogInfo able to mute all logs in inference.	5 years ago
Zhaolong Xing	da7748c53d	add conv, depthwise_conv, pooling (#20966) ... test=develop	5 years ago
GaoWei8	250a192181	Add ernie large c++ inference test (#21365) ... * add ernie-large test test=develop * add ernie large c++ inference test test=develop	5 years ago
Zhaolong Xing	b39c011637	specify the auto growth allocator for inference. (#21448) ... test=develop	5 years ago
Tao Luo	01fa4ead61	fix -Wno-error=sign-compare warning in gcc8 (#21434) ... * fix -Wno-error=sign-compare warning in gcc8 test=develop * fix warning in distributed codes test=develop	5 years ago
Lv Mengsi	37f3e56dea	Fix transpose conv (#21406) ... * fix transpose conv,test=develop * fix comments test=develop	5 years ago
lidanqing	c0aa13672e	Fp32 vs int8 qat C++ performance (#21244) ... * add ut for comparing FP32 and QAT INT8 * add save qat transformed model python script test=develop * updated * added missing file * add "with_label" test=develop * performance benchmark as unit test test=develop * change names of unnecessary thing * Change CMakeList.txt for model downloading and UT test=develop * change names of functions and params for more readable code test=develop * Change PADDLE_ENFORCE messages test=develop * fix indent problems test=develop * indent problems test=develop	5 years ago
Zhaolong Xing	d1a6e112e6	fix C++ multicard inference bug. (#20955) ... test=develop	5 years ago
Michał Gallus	5d7d548275	INT8 Fully-connected (#17641) ... * Implement Int8 FC * Integrate FC into INT8v2 test=develop * int8 FC: transpose weights before computing scales test=develop * Add support for activation_type string in FC test=develop * Disable MKL-DNN's FC in VGG16 and 19 test=develop * Disable FC quantization when mkldnn FC is disabled test=develop * Solve PADDLE_ENFORCES in FC int8 * Fix Paddle enforces and remove const cast test=develop * Fix style changes test=develop * Fix quantizer_tester test and add fc quantization test=develop * Fix FC test fail on CUDA * Remove unnecessary log from quantize placement pass test=develop * Add Thread ID to FC hash key test=develop * Add comments to MKL-DNN FC Kernel test=develop * Refactor quantizer test=develop * Fix linter issues test=develop * Fix crash in slim googlenet test=develop * Fix PADDLE_ENFORCE messages test=develop	5 years ago
GaoWei8	234060f88f	Add fc padding to improve mkl GEMM's performance when N and K are multiple of 128. (#20972) ... * Add fc padding to solve mkl performance test=develop * fix gpu pass and error information test=develop * fix fc_fuse_pass_test test=develop * fix error information test=develop * fix error information test=develop * fix name and add fc op padding test test=develop * fix attributes test=develop * optimize fc padding test=develop * fix test test=develop	5 years ago
silingtong123	45c1e7bb7b	add prediction demo and script on windows (#21248)	5 years ago
zhouwei25	345b67b5e2	remove warning LNK4006 and warning LNK4221 (#21226)	5 years ago
liu zhengxi	3cb6c0a059	Fix the CAPI ZeroCopy shape error and reuse the code to get output (#21240) ... * fix the CAPI ZeroCopy shape error and reconstruct the output obtain * use an anonymous namespace to cover the functor * fix unit tests because of the output of typeid(T).name() is different from linux and windows, test=develop	5 years ago
Pei Yang	2e2f92a5b1	fix trt weight bug (#21231) ... added splitter "__" between weight name and suffix number to avoid conflicts.	5 years ago
zhouwei25	c0dcb090a3	Determine whether to copy and link inference lib by ON_INFER (#20931)	5 years ago
Zhaolong Xing	65f7052554	TRT int8: refine trt int8 for dynamic range set (#21112) ... * refine trt int8 for dynamic range set test=develop * refine trt int8 test=develop	5 years ago
GaoWei8	a9d4eed3a8	fix cmake fails on inference_download_and_uncompress (#21185) ... * solve cmake fails on inference_download_and_uncompress test=develop * solve cmake fails on inference_download_and_uncompress test=develop	5 years ago
Adam	d74ea0855f	Add relative error measure when (value > 1) (#21144) ... * Add relative error measure when value > 1 test=develop * Move code to CheckError function test=develop	5 years ago
Chen Weihang	8414575b78	Add examples for error message writing specification - PreconditionNotMet, Unimplemented, Unavailable (#21137) ... * add examples for error spec, test=develop * change ENFORCE to ENFORCE_**, test=develop	5 years ago
joanna.wozna.intel	77c2083586	Add transpose2 INT8 for mkl-dnn (#19424) ... * Add transpose2 INT8 for mkl-dnn test=develop * Fix test_transpose_int8_mkldnn test=develop * Revert "Merge branch 'develop' into transpose_int8_mkldnn_2" This reverts commit 34011bdba4c859abb945e062ab13124f70508054, reversing changes made to 2ce6473f144da298aba4a43d46918f27d463cf7c. * Revert "Revert "Merge branch 'develop' into transpose_int8_mkldnn_2"" This reverts commit 23754dd78ca47ae56881161172b2aacd349aba90. * Add template to TransposeMKLDNNHandler test=develop * Resolve conflict test=develop * Restore get_size and refactor test=develop	5 years ago
GaoWei8	829bf871d7	Add ernie c++ inference test (#21015) ... * Add ernie unit test test=develop * Add ernie unit test test=develop * Add ernie unit test test=develop * remove ngraph * optimize gpu test test=develop * optimize codes test=develop	5 years ago
Pei Yang	e89c16b90d	Bug Fix: Paddle-TRT cannot handle adaptive pooling in pool2d op converter and "num" attribute in split op converter (#20733) ... * fix pool2d trt converter, test=develop * add fix for split op converter, test=develop	5 years ago
石晓伟	e742760f8e	optimize version error, test=develop (#20715)	5 years ago
bingyanghuang	fd49ebcbd8	update int8 benchmark with 6271 data, test=develop test=document_fix (#20736)	5 years ago
石晓伟	d8f4f4239d	Ensure backward compatibility with the anakin interface, test=develop (#20691) ... * support MLU nums, test=develop * change anakin apis, test=develop	5 years ago
liu zhengxi	d39777fefa	alter the capi of PD_PredictorRun to provide proper function, test=develop (#20697) ... modify the way to pass parameter out_size in function.	5 years ago
liu zhengxi	dbc2bb3376	improve the performance of capi in PD_PredictorRun (#20665)	5 years ago
lidanqing	57b656f956	Add document for int8 object detection quantization (#19356)	5 years ago
liu zhengxi	922d432477	fix the PD_ZeroCopyPredictorRun output problem (#20612) ... * fix the PD_ZeroCopyPredictorRun output problem and add some checks and logs for users * modify the cmakelists depends and fix the cmakelists problem	5 years ago
bingyanghuang	85e1f2150b	Modify the helper information in full_pascalvoc_test_preprocess.py (#20475)	5 years ago
Pei Yang	443f604c3b	add DisableGlogInfo() to AnalysisConfig, test=develop (#20581)	5 years ago
zhaoyuchen2018	b8333edef6	Add Multihead matmul fuse pass (#20167) ... * Add multihead fuse pass for ernie opt * Refine softmax test=develop * Refine cuda kernel * Refine cuda version * Refine cmake test=develop * refine header file * refine test case and pass * refine comments	5 years ago
Adam	7faa3e9555	Add ConvTranspose + BatchNorm fuse pass (#20161) ... * Add ConvTranspose + BatchNorm fuse pass test=develop * Add tests for conv+bn and conv_transpose+bn passes test=develop	5 years ago
liu zhengxi	53d8799bee	remove incorrect new in c style, test=develop (#20370) ... remove incorrect "new" in c style.	5 years ago
石晓伟	2c28e3283a	fix analysis_predictor ci, test=release/1.6 (#20141)	5 years ago
liu zhengxi	acb02fd69e	add dll to inference capi (#20180) ... * add dll to inference capi, test=develop * add if win32 in cmakelists, test=develop	5 years ago
liu zhengxi	301eeb5bea	Add capi for fluid inference api (#20092) ... * add capi for fluid inference api, including AnalysisConfig, AnalysisPredictor, PaddleBuf, PaddleTensor, ZeroCopyTensor	5 years ago
Wilber	276b5e3440	fix compile paddle with anakin bug ... * fix compile with anakin bug * remove useless deps test=develop - 修复了联编anakin时，遇到的bug. - 编译test_anakin_activate 不通过 - 编译test_anakin_engine 不通过	5 years ago
石晓伟	01b9d07963	update operator compatible info, test=develop (#19978) ... * update operator compatible info, test=develop * revert cmake/version.cmake, test=develop * add unit_tests and fix bugs, test=develop * update ../paddle/fluid/framework/framework.proto, test=develop * fix bug of paddle/fluid/inference/api/analysis_predictor.cc, test=develop * update paddle/fluid/framework/version_test.cc, test=develop * add comments and rename interfaces, test=develop	5 years ago
Zhaolong Xing	e89b12884a	FIx C++ inference BUG: When open memory optim and enable trt subgraph at the same time, there is a bug (#19969) ... * fix memory optimization type test=develop * 1. fix BUG: open trt and memory optim will trigger bug. 2. Clean memory optim bug. test=develop	5 years ago
Aurelius84	99a9615a4b	Removing length dims constraints of seq_pad and seq_unpad (#19497) ... * Removing last dims constraints of seq_pad and seq_unpad test=develop * fix test_layer api code test=develop * fix sequence_pad_op.cc conflict test=develop * remove test_analyzer_mm_dnn test=develop * fix vectorize bug test=develop * fix vectorize<int> test=develop	5 years ago
pawelpiotrowicz	2c5c636514	Add two extra flags for test_analyzer_int8_image_classification to disable fp32/int8 (#19840) ... test=develop	5 years ago
Pei Yang	baccd7e2ca	Add TRT input shape check between model and runtime (#19864) ... * add TRT shape check, test=develop * model_input_shape == runtime_input_shape, refine message, test=develop	5 years ago
Pei Yang	74812d1c90	Fix BUGS: paddle-TRT repeatedly sets weight_map and overdeletes repetitive_params (#19825) ... * fix trt bugs when sharing params, test=develop * add unittest for cascade_rcnn	5 years ago
石晓伟	d004a0f50e	fix multi-thread exec of trt, test=develop (#19338)	5 years ago
Yiqun Liu	3cd985a669	Add a pass to fuse fc+elementwise_add+layernorm (#19776) ... * Add fc_elementwise_layernorm_fuse pass and unittest. * Add fused_fc_elementwise_layernorm op and its GPU kernel. test=develop * Apply fc_elementwise_layernorm_fuse_pass to GPU inference. * Add the setting of attrs in the definition of binary_op. test=develop * Add comment. * Implement the unittest. test=develop * Change the unittest name of layer_norm. test=develop	6 years ago
石晓伟	71b2ed61bc	support MLU nums, test=develop (#19372)	6 years ago
Pei Yang	9cbc1eff2d	zerocopytensor support uint8, analysis config support profile, analysis predictor support GetInputTensorShape, test=develop (#19822)	6 years ago
Zhaolong Xing	110be57c1b	fix memory optimization type (#19781) ... test=develop	6 years ago
Yiqun Liu	c67c8758cb	Enhance fc_fuse_pass to enable fusing relu to fc_op (#19733) ... * Refine the codes related to fc op. * Add GPU implementation for fc functor. * Apply fc_fuse_pass in GPU inference. test=develop * Change the cmake for fc op. * Change PADDLE_ENFORCE to PADDLE_ENFORCE_EQ. * Add an attribute to set the activation type in fc_op. * Enhance the unittest of fc_op. test=develop * Remove the declaration of FCOpGrad back to the header file. test=develop * Set default value for newly added arguments in test_fc_op. test=develop * Enhance fc_fuse_pass to enable fusing relu. * Allow print the shapes of var_desc in graph. test=develop * Enhance fc_fuse_pass_tester. * Remove the use of PADDLE_ENFORCE. test=develop * Correct the number of ops after fusing. test=develop * Fix a typo. test=develop * Set activation_type to null when there is no relu in fc. test=develop * Refine fc_fuse_pass's codes. * Enable the set of shape for tensor. * Refine repeated_fc_relu_pass and add unittest. test=develop	6 years ago
Yiqun Liu	a65c728e5d	Implement the GPU kernel of fc operator (#19687) ... * Refine the codes related to fc op. * Add GPU implementation for fc functor. * Apply fc_fuse_pass in GPU inference. test=develop * Change the cmake for fc op. * Change PADDLE_ENFORCE to PADDLE_ENFORCE_EQ. * Add an attribute to set the activation type in fc_op. * Enhance the unittest of fc_op. test=develop * Remove the declaration of FCOpGrad back to the header file. test=develop * Set default value for newly added arguments in test_fc_op. test=develop	6 years ago
Tao Luo	f05d2c519d	paddle::framework::vectorize() templatization [PART3] (#19643) ... * paddle::framework::vectorize() templatization test=develop * update pybind/imperative.cc test=develop * revert update on unsqueeze_op.cc and warpctc_cudnn_op.cu.cc test=develop	6 years ago
Tao Luo	3ae939e48a	unify PADDLE_ASSERT_MSG into PADDLE_ENFORCE(error_message) (#19631) ... * remove assert.h * change PADDLE_ASSERT_MSG to PADDLE_ENFORCE test=develop * fix tensorrt paddle_enforce test=develop	6 years ago
baojun	a3a4b6e570	Enable ngraph through build_strategy (#19266) ... * enable ngraph throught build_strategy test=develop * add unittest test=develop * put use_ngraph unconditional test=develop * remove paddle_enforce test=develop * remove paddle_enforce test=develop * fix copyright test=develop * limit for ngraph only test=develop	6 years ago
Yiqun Liu	c5548178b0	A a pass to enable the use of cudnn (#19346) ... * Add a interface to enable cudnn for inference. * Add cudnn_placement_pass. test=develop * Set the default value of cudnn_enabled_op_types to null. test=develop * Write the common basic class, placement_pass_base, to refine the codes. test=develop * Call EnableCUDNN in unittest. test=develop * Refine cudnn_placement_pass tester. * Enable the testing of cudnn_placement_pass in inference's unittest. test=develop * Add the check of op kernels. test=develop	6 years ago
liuwei1031	d6cb1a4122	add dynamic C runtime support on windows, test=develop (#19502)	6 years ago
Yiqun Liu	fcec365d29	Add a pass to replace dropout_op with scale_op when is_test is true (#19297) ... * Add simplify_with_basic_ops_pass to replace dropout_op with scale_op when is_test is true. test=develop * Delete dropout_op directly when upscale_in_train is true. test=develop * Improve the debug string, adding the print of op_desc information. * Fix the case when dropout's input x is reused as the next op's output. * Add the pass to inference. test=develop * Change the log level. test=develop * Add unittest for inplace case. * Add comment to explain the pass. * Apply the pass for CPU inference. test=develop * Fix the typo. test=develop * Add the check of AttrType. test=develop	6 years ago
lidanqing	9240e5325c	add local user data conversion into full_pascalvoc_test_preprocess.py (#19283) ... * add local user data conversion into full_pascalvoc_test_preprocess.py test=develop * change PADDLE_ENFORCE to PADDLE_ENFORCE_GE test=develop * change according to reviews test=develop	6 years ago