1180 Commits (4f81d1bd5f9be4a564cfc8bd7e2a2bc3b21c24d1)

Author	SHA1	Message	Date
Pei Yang	20d61414b4	fix glog warning, test=develop (#21573)	6 years ago
Pei Yang	122b37ce62	make config option DisableGlogInfo() able to mute all inference logs (#21318) ... * make DisableGlogInfo able to mute all logs in inference.	6 years ago
Zhaolong Xing	da7748c53d	add conv, depthwise_conv, pooling (#20966) ... test=develop	6 years ago
GaoWei8	250a192181	Add ernie large c++ inference test (#21365) ... * add ernie-large test test=develop * add ernie large c++ inference test test=develop	6 years ago
Zhaolong Xing	b39c011637	specify the auto growth allocator for inference. (#21448) ... test=develop	6 years ago
Tao Luo	01fa4ead61	fix -Wno-error=sign-compare warning in gcc8 (#21434) ... * fix -Wno-error=sign-compare warning in gcc8 test=develop * fix warning in distributed codes test=develop	6 years ago
Lv Mengsi	37f3e56dea	Fix transpose conv (#21406) ... * fix transpose conv,test=develop * fix comments test=develop	6 years ago
lidanqing	c0aa13672e	Fp32 vs int8 qat C++ performance (#21244) ... * add ut for comparing FP32 and QAT INT8 * add save qat transformed model python script test=develop * updated * added missing file * add "with_label" test=develop * performance benchmark as unit test test=develop * change names of unnecessary thing * Change CMakeList.txt for model downloading and UT test=develop * change names of functions and params for more readable code test=develop * Change PADDLE_ENFORCE messages test=develop * fix indent problems test=develop * indent problems test=develop	6 years ago
Zhaolong Xing	d1a6e112e6	fix C++ multicard inference bug. (#20955) ... test=develop	6 years ago
Michał Gallus	5d7d548275	INT8 Fully-connected (#17641) ... * Implement Int8 FC * Integrate FC into INT8v2 test=develop * int8 FC: transpose weights before computing scales test=develop * Add support for activation_type string in FC test=develop * Disable MKL-DNN's FC in VGG16 and 19 test=develop * Disable FC quantization when mkldnn FC is disabled test=develop * Solve PADDLE_ENFORCES in FC int8 * Fix Paddle enforces and remove const cast test=develop * Fix style changes test=develop * Fix quantizer_tester test and add fc quantization test=develop * Fix FC test fail on CUDA * Remove unnecessary log from quantize placement pass test=develop * Add Thread ID to FC hash key test=develop * Add comments to MKL-DNN FC Kernel test=develop * Refactor quantizer test=develop * Fix linter issues test=develop * Fix crash in slim googlenet test=develop * Fix PADDLE_ENFORCE messages test=develop	6 years ago
GaoWei8	234060f88f	Add fc padding to improve mkl GEMM's performance when N and K are multiple of 128. (#20972) ... * Add fc padding to solve mkl performance test=develop * fix gpu pass and error information test=develop * fix fc_fuse_pass_test test=develop * fix error information test=develop * fix error information test=develop * fix name and add fc op padding test test=develop * fix attributes test=develop * optimize fc padding test=develop * fix test test=develop	6 years ago
silingtong123	45c1e7bb7b	add prediction demo and script on windows (#21248)	6 years ago
zhouwei25	345b67b5e2	remove warning LNK4006 and warning LNK4221 (#21226)	6 years ago
liu zhengxi	3cb6c0a059	Fix the CAPI ZeroCopy shape error and reuse the code to get output (#21240) ... * fix the CAPI ZeroCopy shape error and reconstruct the output obtain * use an anonymous namespace to cover the functor * fix unit tests because of the output of typeid(T).name() is different from linux and windows, test=develop	6 years ago
Pei Yang	2e2f92a5b1	fix trt weight bug (#21231) ... added splitter "__" between weight name and suffix number to avoid conflicts.	6 years ago
zhouwei25	c0dcb090a3	Determine whether to copy and link inference lib by ON_INFER (#20931)	6 years ago
Zhaolong Xing	65f7052554	TRT int8: refine trt int8 for dynamic range set (#21112) ... * refine trt int8 for dynamic range set test=develop * refine trt int8 test=develop	6 years ago
GaoWei8	a9d4eed3a8	fix cmake fails on inference_download_and_uncompress (#21185) ... * solve cmake fails on inference_download_and_uncompress test=develop * solve cmake fails on inference_download_and_uncompress test=develop	6 years ago
Adam	d74ea0855f	Add relative error measure when (value > 1) (#21144) ... * Add relative error measure when value > 1 test=develop * Move code to CheckError function test=develop	6 years ago
Chen Weihang	8414575b78	Add examples for error message writing specification - PreconditionNotMet, Unimplemented, Unavailable (#21137) ... * add examples for error spec, test=develop * change ENFORCE to ENFORCE_**, test=develop	6 years ago
joanna.wozna.intel	77c2083586	Add transpose2 INT8 for mkl-dnn (#19424) ... * Add transpose2 INT8 for mkl-dnn test=develop * Fix test_transpose_int8_mkldnn test=develop * Revert "Merge branch 'develop' into transpose_int8_mkldnn_2" This reverts commit 34011bdba4c859abb945e062ab13124f70508054, reversing changes made to 2ce6473f144da298aba4a43d46918f27d463cf7c. * Revert "Revert "Merge branch 'develop' into transpose_int8_mkldnn_2"" This reverts commit 23754dd78ca47ae56881161172b2aacd349aba90. * Add template to TransposeMKLDNNHandler test=develop * Resolve conflict test=develop * Restore get_size and refactor test=develop	6 years ago
GaoWei8	829bf871d7	Add ernie c++ inference test (#21015) ... * Add ernie unit test test=develop * Add ernie unit test test=develop * Add ernie unit test test=develop * remove ngraph * optimize gpu test test=develop * optimize codes test=develop	6 years ago
Pei Yang	e89c16b90d	Bug Fix: Paddle-TRT cannot handle adaptive pooling in pool2d op converter and "num" attribute in split op converter (#20733) ... * fix pool2d trt converter, test=develop * add fix for split op converter, test=develop	6 years ago
石晓伟	e742760f8e	optimize version error, test=develop (#20715)	6 years ago
bingyanghuang	fd49ebcbd8	update int8 benchmark with 6271 data, test=develop test=document_fix (#20736)	6 years ago
石晓伟	d8f4f4239d	Ensure backward compatibility with the anakin interface, test=develop (#20691) ... * support MLU nums, test=develop * change anakin apis, test=develop	6 years ago
liu zhengxi	d39777fefa	alter the capi of PD_PredictorRun to provide proper function, test=develop (#20697) ... modify the way to pass parameter out_size in function.	6 years ago
liu zhengxi	dbc2bb3376	improve the performance of capi in PD_PredictorRun (#20665)	6 years ago
lidanqing	57b656f956	Add document for int8 object detection quantization (#19356)	6 years ago
liu zhengxi	922d432477	fix the PD_ZeroCopyPredictorRun output problem (#20612) ... * fix the PD_ZeroCopyPredictorRun output problem and add some checks and logs for users * modify the cmakelists depends and fix the cmakelists problem	6 years ago
bingyanghuang	85e1f2150b	Modify the helper information in full_pascalvoc_test_preprocess.py (#20475)	6 years ago
Pei Yang	443f604c3b	add DisableGlogInfo() to AnalysisConfig, test=develop (#20581)	6 years ago
zhaoyuchen2018	b8333edef6	Add Multihead matmul fuse pass (#20167) ... * Add multihead fuse pass for ernie opt * Refine softmax test=develop * Refine cuda kernel * Refine cuda version * Refine cmake test=develop * refine header file * refine test case and pass * refine comments	6 years ago
Adam	7faa3e9555	Add ConvTranspose + BatchNorm fuse pass (#20161) ... * Add ConvTranspose + BatchNorm fuse pass test=develop * Add tests for conv+bn and conv_transpose+bn passes test=develop	6 years ago
liu zhengxi	53d8799bee	remove incorrect new in c style, test=develop (#20370) ... remove incorrect "new" in c style.	6 years ago
石晓伟	2c28e3283a	fix analysis_predictor ci, test=release/1.6 (#20141)	6 years ago
liu zhengxi	acb02fd69e	add dll to inference capi (#20180) ... * add dll to inference capi, test=develop * add if win32 in cmakelists, test=develop	6 years ago
liu zhengxi	301eeb5bea	Add capi for fluid inference api (#20092) ... * add capi for fluid inference api, including AnalysisConfig, AnalysisPredictor, PaddleBuf, PaddleTensor, ZeroCopyTensor	6 years ago
Wilber	276b5e3440	fix compile paddle with anakin bug ... * fix compile with anakin bug * remove useless deps test=develop - 修复了联编anakin时，遇到的bug. - 编译test_anakin_activate 不通过 - 编译test_anakin_engine 不通过	6 years ago
石晓伟	01b9d07963	update operator compatible info, test=develop (#19978) ... * update operator compatible info, test=develop * revert cmake/version.cmake, test=develop * add unit_tests and fix bugs, test=develop * update ../paddle/fluid/framework/framework.proto, test=develop * fix bug of paddle/fluid/inference/api/analysis_predictor.cc, test=develop * update paddle/fluid/framework/version_test.cc, test=develop * add comments and rename interfaces, test=develop	6 years ago
Zhaolong Xing	e89b12884a	FIx C++ inference BUG: When open memory optim and enable trt subgraph at the same time, there is a bug (#19969) ... * fix memory optimization type test=develop * 1. fix BUG: open trt and memory optim will trigger bug. 2. Clean memory optim bug. test=develop	6 years ago
Aurelius84	99a9615a4b	Removing length dims constraints of seq_pad and seq_unpad (#19497) ... * Removing last dims constraints of seq_pad and seq_unpad test=develop * fix test_layer api code test=develop * fix sequence_pad_op.cc conflict test=develop * remove test_analyzer_mm_dnn test=develop * fix vectorize bug test=develop * fix vectorize<int> test=develop	6 years ago
pawelpiotrowicz	2c5c636514	Add two extra flags for test_analyzer_int8_image_classification to disable fp32/int8 (#19840) ... test=develop	6 years ago
Pei Yang	baccd7e2ca	Add TRT input shape check between model and runtime (#19864) ... * add TRT shape check, test=develop * model_input_shape == runtime_input_shape, refine message, test=develop	6 years ago
Pei Yang	74812d1c90	Fix BUGS: paddle-TRT repeatedly sets weight_map and overdeletes repetitive_params (#19825) ... * fix trt bugs when sharing params, test=develop * add unittest for cascade_rcnn	6 years ago
石晓伟	d004a0f50e	fix multi-thread exec of trt, test=develop (#19338)	6 years ago
Yiqun Liu	3cd985a669	Add a pass to fuse fc+elementwise_add+layernorm (#19776) ... * Add fc_elementwise_layernorm_fuse pass and unittest. * Add fused_fc_elementwise_layernorm op and its GPU kernel. test=develop * Apply fc_elementwise_layernorm_fuse_pass to GPU inference. * Add the setting of attrs in the definition of binary_op. test=develop * Add comment. * Implement the unittest. test=develop * Change the unittest name of layer_norm. test=develop	6 years ago
石晓伟	71b2ed61bc	support MLU nums, test=develop (#19372)	6 years ago
Pei Yang	9cbc1eff2d	zerocopytensor support uint8, analysis config support profile, analysis predictor support GetInputTensorShape, test=develop (#19822)	6 years ago
Zhaolong Xing	110be57c1b	fix memory optimization type (#19781) ... test=develop	6 years ago