431 Commits (720641725941b7e49b8926c65476c631ab6bef03)

Author	SHA1	Message	Date
Pei Yang	43f9f180e5	Add api to clear intermediate tensors in AnalysisPredictor (#25069) ... * add api to clear intemediate tensors in analysis predictor. test=develop * add python api. test=develop	5 years ago
Wilber	4474fc1033	fix compile on windows. test=develop (#25310)	5 years ago
Wojciech Uss	23a4f54b73	rename qat into quant (#24948) ... test=develop	5 years ago
Wojciech Uss	56fa3880e3	rename qat into quant in filenames only (#25194) ... test=develop	5 years ago
Pei Yang	b2f5a149e7	[Paddle-TRT] Better Paddle-TensorRT support for PaddleSlim quant models (#25097) ... * Paddle-TensorRT support slim QAT. test=develop * add comments. test=develop * use RenameInput instead of ResetInputs. test=develop	5 years ago
iducn	f282599229	disable unitest for gcc8(#25134)	5 years ago
Wilber	f8e370ac7f	[Inference] [unittest] Inference unit tests rely on dynamic libraries (#24743)	5 years ago
silingtong123	126d3d693b	support C++ inference shared library on windows (#24672) ... * add SetCommandLineOption * add the print_FLAGS function * remove the test demo * modify the location of macro * add the 'WITH_STATIC_LIB' option on windows * modify the macro of PD_INFER_DECL * modify the the fuction name * modify the unittest * modify the code style	5 years ago
Zhaolong Xing	f68d4fb3f1	fix bert bug using trt6 when compile with CUDA_ARCH_NAME=All (#24517) ... test=develop	5 years ago
Tao Luo	72c370c8d2	remove unused test_multi_thread_helper.h (#24399) ... test=develop	5 years ago
Tao Luo	63da846de0	remove old inference C++ tests (#24368)	5 years ago
Chen Weihang	aa0f254fbe	Add macro BOOST_GET to enrich the error information of boost :: get (#24175) ... * add new macro BOOST_GET_SAFELY & unittests, test=develop * add different macro type, test=develop * fix get macro type in executor, test=develop * four macro part change backup * using one macro for all case, test=develop * revert attribute change, test=develop * change to three func to solve gcc4.8 bug, test=develop * polish some details, test=develop	5 years ago
Tao Luo	c1df7048c7	add UT for mkldnn_cache_capacity (#24336) ... * add UT for mkldnn_cache_capacity test=develop * fix comparison of integer expressions of different signedness test=develop	5 years ago
石晓伟	17ac6e2580	update the analysis predictor for multi-stream support, test=develop (#24046) ... * update the analysis predictor, test=develop * update the unit test, test=develop * no priority set before the inferface determined, test=develop * interface name generalization, test=develop	5 years ago
lidanqing	61ec30f030	Update QAT INT8 2.0 doc (#24127) ... * update local data preprocess doc * update for 2.0 QAT test=develop test=document_fix * update benchmark data test=develop test=document_fix Co-authored-by: Wojciech Uss <wojciech.uss@intel.com>	5 years ago
Pei Yang	695a53c874	remove conv_bn_fuse_pass and fc_fuse_pass in trt int8 calibration. test=develop (#23805)	5 years ago
Zhaolong Xing	133f1fc123	[Eernie TRT]: add slice op and add emb eltwise layernorm fp16 support (#23723) ... * refine ernie trt dynamic shape support 1. add slice op converter 2. add emb eltwise layernorm fp16 support test=develop * fix dynamic shape test ut test=develop * fix comments. test=develop * fix comments test=develop	5 years ago
guofei	2b896c1f6b	Support LoDTensorArray in fetch (#23645) ... * Support LoDTEnsorArray in fetch op test=develop * Support LoDTensorArray in fetch test=develop * Support LoDTensorArray in fetch test=develop * Support LoDTensorArray in fetch test=develop * Support LoDTensorArray in fetch test=develop * Support LoDTensorArray in fetch test=develop * Support LoDTensorArray in fetch test=develop * Support LoDTensorArray in fetch test=develop * Support LoDTensorArray in fetch test=develop * Support LoDTensorArray in fetch test=develop	5 years ago
lidanqing	2291634c5c	Add user local data preprocess support (#23692) ... * add local data preprocess support for imagenet test=develop * add local data2bin tests test=develop * locally two tests passed test=develop * change according to reviews test=develop	5 years ago
Zhaolong Xing	3acb047a20	[Paddle-TRT]: add eltwise,pool2d, prelu, scale, concat, gelu dynamic shape support (#23396) ... * add elementwise pool2d, prelu, shuffle channel test=develop * add scale and refine concat eltwise conveter test=develop * refine elementwise converter test=develop * refine ut test and enforce error. test=develop * modify const cast test=develop	5 years ago
mozga-intel	3baaee9aab	Remove: NGraph engine from PDPD repository (#23545) ... * Remove the NGraph engine from PDPD repository 1. Each operator was removed from the operator's directory 2. Each test was removed from the unittest directory 3. The parallel executor support was removed from the PDPD 4. The CMake file was removed from the PDPD 5. The NG flags were removed from the repository test=develop * Remove ngraph from: 1. Cmake file 2. Python file test=develop	5 years ago
Zhaolong Xing	1a6ce8b910	add swish split gelu plugin dynamic support (#23305) ... test=develop	5 years ago
Zhaolong Xing	430b0099c9	[Paddle-TRT]: Ernie Dynamic shape support. (#23138) ... * add dynamic plugin support. test=develop * change emb eltwise layernorm to math function test=develop * add emb eltwise layernorm test=develop * can run dynamic shape ernie test=develop * fix ci test=develop * add ut for trt ernie dynamic test=develop * refine dynamic shape c++ interface. test=develop * fix comments test=develop * fix comments test=develop	5 years ago
Zhaolong Xing	dd67d44a50	[Paddle-TRT] : (Part1) Dynamic shape support (#22868) ... * change the ci trt from version 5. to 6.0 * paddle-trt dynamic shape support init * conv+bias or conv+bn dynamic shape support test=develop * modity trt engine opconvert test=develop * fix ci error test=develop	5 years ago
Michał Gallus	0038bfbd1d	Prevent loading of warmup data in analyzer_int8 if enable_int8 is set to false (#22857)	5 years ago
liu zhengxi	324f2b3922	Fix inference c api PD_GetZeroCopyOutput lod (#22768) ... * fix inference c api lod, test=develop * fix capi lod problem and enrich tests, test=develop * delete useless header files and alter const_cast, test=develop	5 years ago
liu zhengxi	71ab0458e1	Fix pointer and c-api encapsulation (#22663) ... * refine pointer and c-api prototype, test=develop * fix new c api profile bug, test=develop * add unit tests, test=develop	5 years ago
GaoWei8	cdf5f6fb8c	Add an inference interface to disable FC padding (#22097) ... * Add an interface of disabling FC padding * fix bert regression * polish fc padding interface * recover pass function * fix argument error * fix mkldnn error	5 years ago
flame	1d503e6a9e	Golang inference API (#22503) ... * support golang inference	5 years ago
Wojciech Uss	4cddb43c5c	Add support for Ernie NLP model to the Slim QAT (#22506) ... * a test for Ernie QAT INT8 accuracy check test=develop * Remove NLP comparison test to split PRs test=develop * Fix typo and tabs, delete commented lines test=develop * re-combine the 2 PRs, test=develop Co-authored-by: Michał Gallus <sand3r@interia.eu> Co-authored-by: bingyanghuang <33643817+bingyanghuang@users.noreply.github.com>	5 years ago
Zhaolong Xing	ceda0b9b1a	[Fix BUG]: Core when multi thread + clone + paddle-trt (#22442) ... * add mutex for trt engine test=develop * add the test for copy_to_cpu test=develop	5 years ago
石晓伟	e1b0d7cbb1	remove anakin from code, test=develop (#22420)	5 years ago
joanna.wozna.intel	3099d9d47c	Restore requantize squash (#22399)	5 years ago
zhouwei25	549e6de7ac	faster build by reduce by-product, reduce linking library and fix compile warning of std=c++11 (#22164)	6 years ago
Wilber	1230c110cb	[fluid-lite] adjust to relative error (#22232) ... - fluid和lite精度比较替换为相对误差	6 years ago
Wojciech Uss	2e90c4eb0a	improve mkldnn_quantizer_config test code coverage (#22216)	6 years ago
Wilber	5750152e80	support fluid-lite subgraph run resnet test=develop (#22191) ... - 添加了fluid-lite子图方式运行resnet的单测 - 修改了依赖Lite的git commit id	6 years ago
石晓伟	ad0dfb17c1	[Feature] Lite subgraph (#22114)	6 years ago
Pei Yang	50bee83f71	add TRT support for instance_norm op (#21928) ... * add TRT support for instance_norm op	6 years ago
Pei Yang	0a51098a71	Add TRT support for BERT (#21135) ... * add gelu plugin * align trt bert with gpu * add support for fused fc with relu, * add unittest for bert trt	6 years ago
lidanqing	9dff56e8e2	change qat_performance with mobilenet, change batch_size of qat2_resnet50 (#21895) ... test=develop	6 years ago
Michał Gallus	a5159d8480	Re-anble vgg and resnet101 models download (#21713) ... test=develop	6 years ago
joanna.wozna.intel	d419b859c0	Add reshape int8 mkldnn op (#21428) ... * Add reshape int8 op test=develop * Change test to CPUPlace test=develop * Correct tests test=develop	6 years ago
Adam	e81f0228df	MKL-DNN 1.0 Update (#20162) ... * MKLDNN v1.0 rebase to Paddle 1.6 test=develop * Add hacky paddle::string::to_string() implementation * vectorize<int64-t>() -> vectorize() cleanup test=develop * PADDLE_ENFORCE and void_cast fixes test=develop * Rebase changes test=develop * Cosmetics test=develop * Delete MKL from mkldnn.cmake test=develop * CMake debug commands test=develop * Delete MKLDNN_VERBOSE and rebase fixes test=develop * Rebase fixes test=develop * Temporarily disable int8 resnet101 vgg16 and vgg19 tests test=develop * Add libmkldnn.so.1 to python setup test=develop * Add libmkldnn.so.1 to inference_lib cmake after rebase test=develop * Post rebase fixes + FC int8 changes test=develop * Fix LRN NHWC test=develop * Fix NHWC conv3d test=develop * Windows build fix + next conv3d fix test=develop * Fix conv2d on AVX2 machines test=develop	6 years ago
rensilin	7f5d532a9c	fix: fail to call ZeroCopyTensor::mutable_data() when device_id is no… (#21461) ... * ZeroCopyTensor::mutable_data in the right device, test=develop * add unittest for zerocopy, test=develop	6 years ago
lidanqing	fbf9eca0d3	QAT Int8 document (#21360) ... * update benchmark for int8v2, QAT1, QAT2 accuracy and performance test=document_fix * change according to reviews test=develop test=document_fix * improve some descriptions and some models test=develop test=document_fix * update models benchmark data test=develop test=document_fix * update int8v2 and qat2 performance test=develop test=document_fix	6 years ago
GaoWei8	250a192181	Add ernie large c++ inference test (#21365) ... * add ernie-large test test=develop * add ernie large c++ inference test test=develop	6 years ago
Tao Luo	01fa4ead61	fix -Wno-error=sign-compare warning in gcc8 (#21434) ... * fix -Wno-error=sign-compare warning in gcc8 test=develop * fix warning in distributed codes test=develop	6 years ago
lidanqing	c0aa13672e	Fp32 vs int8 qat C++ performance (#21244) ... * add ut for comparing FP32 and QAT INT8 * add save qat transformed model python script test=develop * updated * added missing file * add "with_label" test=develop * performance benchmark as unit test test=develop * change names of unnecessary thing * Change CMakeList.txt for model downloading and UT test=develop * change names of functions and params for more readable code test=develop * Change PADDLE_ENFORCE messages test=develop * fix indent problems test=develop * indent problems test=develop	6 years ago
GaoWei8	234060f88f	Add fc padding to improve mkl GEMM's performance when N and K are multiple of 128. (#20972) ... * Add fc padding to solve mkl performance test=develop * fix gpu pass and error information test=develop * fix fc_fuse_pass_test test=develop * fix error information test=develop * fix error information test=develop * fix name and add fc op padding test test=develop * fix attributes test=develop * optimize fc padding test=develop * fix test test=develop	6 years ago