507 Commits (13b03e7ad6e9d555b972cca8e5e84ee0d4b61c99)

Author	SHA1	Message	Date
Zhaolong Xing	133f1fc123	[Eernie TRT]: add slice op and add emb eltwise layernorm fp16 support (#23723) ... * refine ernie trt dynamic shape support 1. add slice op converter 2. add emb eltwise layernorm fp16 support test=develop * fix dynamic shape test ut test=develop * fix comments. test=develop * fix comments test=develop	5 years ago
guofei	2b896c1f6b	Support LoDTensorArray in fetch (#23645) ... * Support LoDTEnsorArray in fetch op test=develop * Support LoDTensorArray in fetch test=develop * Support LoDTensorArray in fetch test=develop * Support LoDTensorArray in fetch test=develop * Support LoDTensorArray in fetch test=develop * Support LoDTensorArray in fetch test=develop * Support LoDTensorArray in fetch test=develop * Support LoDTensorArray in fetch test=develop * Support LoDTensorArray in fetch test=develop * Support LoDTensorArray in fetch test=develop	5 years ago
Pei Yang	c528f1d4f3	[Paddle-TRT] Add hard_sigmoid and hard_swish support(support MobilenetV3) (#23672) ... * add hard_sigmoid trt op converter * add hard_swish op converter and plugin. test=develop * add macro to adapt lower trt version. test=develop	5 years ago
joanna.wozna.intel	12ba05ce0c	Add scale-matmul fuse pass (#23734)	5 years ago
Zhaolong Xing	3acb047a20	[Paddle-TRT]: add eltwise,pool2d, prelu, scale, concat, gelu dynamic shape support (#23396) ... * add elementwise pool2d, prelu, shuffle channel test=develop * add scale and refine concat eltwise conveter test=develop * refine elementwise converter test=develop * refine ut test and enforce error. test=develop * modify const cast test=develop	5 years ago
chenhaoze	9b06dd8628	Add three passes and api reference of paddle_pass_builder. test=develop (#23741) ... * Add three passes and api reference of paddle_pass_builder.h	5 years ago
Tao Luo	e4f1b1c5e1	solve mklml memory leak (#23557)	5 years ago
mozga-intel	3baaee9aab	Remove: NGraph engine from PDPD repository (#23545) ... * Remove the NGraph engine from PDPD repository 1. Each operator was removed from the operator's directory 2. Each test was removed from the unittest directory 3. The parallel executor support was removed from the PDPD 4. The CMake file was removed from the PDPD 5. The NG flags were removed from the repository test=develop * Remove ngraph from: 1. Cmake file 2. Python file test=develop	5 years ago
Pei Yang	3d5d217030	Revert "[Paddle-TRT] Add hard_sigmoid and hard_swish support(support MobilenetV3) (#23536)", test=develop (#23642) ... This reverts commit cdc6d4e292.	5 years ago
joanna.wozna.intel	ce08fdcf2b	Add support for INT8 matmul in C-API quantization (#23463) ... * Integrate matmul with cpu_quantize_pass test=develop * Add matmul checking scales test=develop * Change condition of matmul quantization test=develop * Remove redundant var test=develop	5 years ago
Pei Yang	cdc6d4e292	[Paddle-TRT] Add hard_sigmoid and hard_swish support(support MobilenetV3) (#23536) ... * add hard_sigmoid trt op converter * add hard_swish op converter and plugin. test=develop	5 years ago
石晓伟	36b82eae0e	refine the doc of paddle_api.h, test=develop (#23402) ... * refine the doc of paddle_api.h, test=develop * fix documents, test=develop	5 years ago
Zhaolong Xing	6a23850a3f	add init value to varis in analysis config. (#23442)	5 years ago
Zhaolong Xing	70782e6379	[Inference doc]: refine paddle_api.h doc (#23354) ... * refine paddle api doc test=develop * fix comments test=develop	5 years ago
Pei Yang	7e439780d9	add full paddle_analysis_config.h APIs. (#23215)	5 years ago
Jacek Czaja	2bb1b0e89e	[DNNL] Added MKL-DNN inplace pass for C-API inference (#23315)	5 years ago
Wilber	0129f4b568	Add some inference API comments for AnalysisPredictor (#23242) ... * add inference api doc. test=develop	5 years ago
Zhaolong Xing	430b0099c9	[Paddle-TRT]: Ernie Dynamic shape support. (#23138) ... * add dynamic plugin support. test=develop * change emb eltwise layernorm to math function test=develop * add emb eltwise layernorm test=develop * can run dynamic shape ernie test=develop * fix ci test=develop * add ut for trt ernie dynamic test=develop * refine dynamic shape c++ interface. test=develop * fix comments test=develop * fix comments test=develop	5 years ago
Pei Yang	46b8d282dc	Add some inference API comments for AnalysisConfig (#23117) ... * add some API comments in paddle_analysis_config.h, test=develop * add some API comments in paddle_analysis_config.h, test=develop	5 years ago
Sylwester Fraczek	abee05a8c8	added mkldnn swish activation (#23041)	5 years ago
Zhang Ting	137d6563fc	add check for assigned data, test=develop (#22960)	5 years ago
Zhaolong Xing	8d6dc102fe	[Ernie GPU Optimize]: Embedding_eltwise_layernorm Fuse (#22494) ... * 1. add embedding eltwise layernorm fuse 2. add embedding eltwise layernorm op 3. refine inplace_add_relu 4. refine fc_eltwise_layernorm test=develop * 1. refine fc test=develop * fix comments test=develop * fix comments test=develop	5 years ago
Zhaolong Xing	dd67d44a50	[Paddle-TRT] : (Part1) Dynamic shape support (#22868) ... * change the ci trt from version 5. to 6.0 * paddle-trt dynamic shape support init * conv+bias or conv+bn dynamic shape support test=develop * modity trt engine opconvert test=develop * fix ci error test=develop	5 years ago
石晓伟	1861ca88f1	serialize the PaddleTensor, test=develop (#22810) ... * encapsulate the PaddleTensorToLoDTensor, test=develop * serialize the pd_tensor, test=develop * serialize tensors to file, test=develop	5 years ago
tianshuo78520a	433cef03e5	fix typo word (#22784)	5 years ago
GaoWei8	cdf5f6fb8c	Add an inference interface to disable FC padding (#22097) ... * Add an interface of disabling FC padding * fix bert regression * polish fc padding interface * recover pass function * fix argument error * fix mkldnn error	5 years ago
flame	f7eafca828	remove python inference warning (#22602)	5 years ago
flame	1d503e6a9e	Golang inference API (#22503) ... * support golang inference	5 years ago
Zhaolong Xing	8acd745c25	[Ernie GPU Optim]: Fuse three fc to multihtead matmul (#22486) ... * 1. optim multihead matmul: fuse three fc to multihtead matmul test=develop * fix conflict test=develop * fix comments test=develop	5 years ago
Zhaolong Xing	ceda0b9b1a	[Fix BUG]: Core when multi thread + clone + paddle-trt (#22442) ... * add mutex for trt engine test=develop * add the test for copy_to_cpu test=develop	5 years ago
石晓伟	e1b0d7cbb1	remove anakin from code, test=develop (#22420)	5 years ago
liu zhengxi	07afc29e90	Make api.cc malloc consistent with paddle_api.h for PaddleBuf (#22255)	5 years ago
silingtong123	4f1da4adcb	remove the useless third_party library from C++ inference library (#22021) ... * remove the useless third_party library from C++ inference library * revert removing the install directory	5 years ago
zhouwei25	549e6de7ac	faster build by reduce by-product, reduce linking library and fix compile warning of std=c++11 (#22164)	5 years ago
石晓伟	ad0dfb17c1	[Feature] Lite subgraph (#22114)	5 years ago
Pei Yang	50bee83f71	add TRT support for instance_norm op (#21928) ... * add TRT support for instance_norm op	5 years ago
Pei Yang	0a51098a71	Add TRT support for BERT (#21135) ... * add gelu plugin * align trt bert with gpu * add support for fused fc with relu, * add unittest for bert trt	5 years ago
zhouwei25	e66f92d1ae	Modify demo_ci to support Windows, prepare for PR_Windows_Inference (#21873)	5 years ago
石晓伟	03479469a7	fix multi-thread error of fc_gru_fuse_pass.cc, test=develop (#21841) ... * fix multi-thread error of fc_gru_fuse_pass.cc, test=develop * export FLAGS and GLOG symbols, test=develop	5 years ago
Michał Gallus	253e664275	Disable memory opt pass when DNNL is on (#21826) ... * Disable memory opt pass when DNNL is on * Refine comment above mem optimization pass enablement test=develop	5 years ago
石晓伟	2bb135825e	fix analysis_predictor when func is called multiple times, test=release/1.6 (#21665)	5 years ago
joanna.wozna.intel	d419b859c0	Add reshape int8 mkldnn op (#21428) ... * Add reshape int8 op test=develop * Change test to CPUPlace test=develop * Correct tests test=develop	5 years ago
Zhaolong Xing	fbbd94a6ce	there is bug for inference using auto grwoth allocator (#21621) ... test=develop	5 years ago
rensilin	7f5d532a9c	fix: fail to call ZeroCopyTensor::mutable_data() when device_id is no… (#21461) ... * ZeroCopyTensor::mutable_data in the right device, test=develop * add unittest for zerocopy, test=develop	5 years ago
Pei Yang	20d61414b4	fix glog warning, test=develop (#21573)	5 years ago
Pei Yang	122b37ce62	make config option DisableGlogInfo() able to mute all inference logs (#21318) ... * make DisableGlogInfo able to mute all logs in inference.	5 years ago
Zhaolong Xing	b39c011637	specify the auto growth allocator for inference. (#21448) ... test=develop	5 years ago
Lv Mengsi	37f3e56dea	Fix transpose conv (#21406) ... * fix transpose conv,test=develop * fix comments test=develop	5 years ago
Zhaolong Xing	d1a6e112e6	fix C++ multicard inference bug. (#20955) ... test=develop	5 years ago
Michał Gallus	5d7d548275	INT8 Fully-connected (#17641) ... * Implement Int8 FC * Integrate FC into INT8v2 test=develop * int8 FC: transpose weights before computing scales test=develop * Add support for activation_type string in FC test=develop * Disable MKL-DNN's FC in VGG16 and 19 test=develop * Disable FC quantization when mkldnn FC is disabled test=develop * Solve PADDLE_ENFORCES in FC int8 * Fix Paddle enforces and remove const cast test=develop * Fix style changes test=develop * Fix quantizer_tester test and add fc quantization test=develop * Fix FC test fail on CUDA * Remove unnecessary log from quantize placement pass test=develop * Add Thread ID to FC hash key test=develop * Add comments to MKL-DNN FC Kernel test=develop * Refactor quantizer test=develop * Fix linter issues test=develop * Fix crash in slim googlenet test=develop * Fix PADDLE_ENFORCE messages test=develop	5 years ago