323 Commits (c21a979790aebefffdde5c470dc406a2a81959e7)

Author	SHA1	Message	Date
Leo Chen	90805e2df7	Register op_version for new attribute use_addto (#28463) ... * register op_version for addto * upgrade pass capability * change eq to le * change eq to le * fix merge	4 years ago
Shang Zhizhou	8699f38d08	裁剪transformer模型trt支持；修复tensorRT不支持DeletePass的bug (#28517) ... * skip_layernorm_op done * add unittest * slice op convertor support trt < 6 * skip_layernorm only work in ernie	4 years ago
joanna.wozna.intel	7821759d48	Add bfloat16 softmax and gelu (#28394) ... * Add bfloat16 softmax and gelu * Add pass attr bfloat16_enabled_op_types * Changes from review	4 years ago
Shang Zhizhou	ea851796e5	TensorRT中ernie模型推理性能优化，支持变长输入 (#28367) ... * fp16 result ok * change -DWITH_NVINFER_PLUGIN toconfig.EnableTensorRtOSS * auto detect special slice op converter for ernie with trt oss * ernie oss only support fp16 * fix special_slice_plugin serialize bug * matmul in tensorrt ok * ernie unittest ok * add matmul tensorrt unittest * remove demo code	4 years ago
joanna.wozna.intel	ddcd1b5381	Add bfloat16 resnet50 test (#27755)	4 years ago
Wilber	9005c5a260	Lite subgraph support arm cpu. (#27827)	4 years ago
Pei Yang	ae6e40a7fd	Add unittests and OP version registry for tensorrt_subgraph_pass (#27544) ... * add unittests and op version register for tensorrt_subgraph_pass * rename to test_trt_subgraph_pass.py * fix softmax converter diff when padding dim=1	4 years ago
wanghuancoder	df43905f12	use iwyu clean include (#27267) ... * use iwyu clean include, test=develop, test=win * compilation error, test=develop * fix compilation error2, test=develop * fix compilation error3, test=develop * fix compilation error4, test=develop * fix compilation error5, test=develop * fix compilation error6, test=develop * fix compilation error7, test=develop * fix compilation error8, test=develop * fix compilation error8, test=develop * fix compilation error10, test=develop * fix compilation error11, test=develop	4 years ago
Wilber	dae62556cb	Enhance infer error info message (#26731)	4 years ago
Wilber	1b84c0bf43	Lite subgraph refine predictor (#27167)	5 years ago
joanna.wozna.intel	95e1434bb2	Add bfloat16 data type (#25402)	5 years ago
LoveAn	02fc1fef8b	Fix the cmake-function named inference_download_and_uncompress on Windows (#26512) ... * Fix the cmake-function named inference_download_and_uncompress with Windows, test=develop * Fix some problems when remove limit of unittests on Windows, test=develop * Using URL to download file instead of DOWNLOAD_COMMAND. test=develop	5 years ago
Wilber	fb72b192e7	[DOC] Fix dead link (#26154)	5 years ago
石晓伟	7206417259	supports xpu runtime, test=develop (#25554) ... * update ResetHolder, test=develop * add TensorShare for lite engine, test=develop * tensor data changed from copying to sharing, test=develop * supports xpu runtime, test=develop * fix code styles, test=develop	5 years ago
Shibo Tao	19c4db1b56	don't re-generate header file if content doesn't change (#25130) ... * don't re-generate header file if content doesn't change. test=develop * add copy_if_different function. test=develop	5 years ago
石晓伟	9ab3cf039c	remove useless test_dot, test=develop (#24957)	5 years ago
Zhou Wei	4058e736ff	temporarily disable these unittests failed on windows (#24942)	5 years ago
Wilber	1e190a9e02	[Inference] [unittest] Inference unit tests rely on dynamic libraries (2) (#24859)	5 years ago
Chen Weihang	aa0f254fbe	Add macro BOOST_GET to enrich the error information of boost :: get (#24175) ... * add new macro BOOST_GET_SAFELY & unittests, test=develop * add different macro type, test=develop * fix get macro type in executor, test=develop * four macro part change backup * using one macro for all case, test=develop * revert attribute change, test=develop * change to three func to solve gcc4.8 bug, test=develop * polish some details, test=develop	5 years ago
mozga-intel	3baaee9aab	Remove: NGraph engine from PDPD repository (#23545) ... * Remove the NGraph engine from PDPD repository 1. Each operator was removed from the operator's directory 2. Each test was removed from the unittest directory 3. The parallel executor support was removed from the PDPD 4. The CMake file was removed from the PDPD 5. The NG flags were removed from the repository test=develop * Remove ngraph from: 1. Cmake file 2. Python file test=develop	5 years ago
Zhaolong Xing	430b0099c9	[Paddle-TRT]: Ernie Dynamic shape support. (#23138) ... * add dynamic plugin support. test=develop * change emb eltwise layernorm to math function test=develop * add emb eltwise layernorm test=develop * can run dynamic shape ernie test=develop * fix ci test=develop * add ut for trt ernie dynamic test=develop * refine dynamic shape c++ interface. test=develop * fix comments test=develop * fix comments test=develop	5 years ago
Zhaolong Xing	dd67d44a50	[Paddle-TRT] : (Part1) Dynamic shape support (#22868) ... * change the ci trt from version 5. to 6.0 * paddle-trt dynamic shape support init * conv+bias or conv+bn dynamic shape support test=develop * modity trt engine opconvert test=develop * fix ci error test=develop	5 years ago
GaoWei8	cdf5f6fb8c	Add an inference interface to disable FC padding (#22097) ... * Add an interface of disabling FC padding * fix bert regression * polish fc padding interface * recover pass function * fix argument error * fix mkldnn error	5 years ago
tianshuo78520a	d2ba91aad1	fix typo words (#22653)	5 years ago
Zhaolong Xing	54a325a52f	[Refine Paddle-TRT INT8]: Support PaddleSlim's Resnet50, Mobilenetv1, Yolov3 models for Inference. (#22483) ... * add int8 op teller for trt. * refine trt int8 * add int8 op teller for trt. test=develop	5 years ago
石晓伟	e1b0d7cbb1	remove anakin from code, test=develop (#22420)	5 years ago
zhouwei25	549e6de7ac	faster build by reduce by-product, reduce linking library and fix compile warning of std=c++11 (#22164)	5 years ago
石晓伟	ad0dfb17c1	[Feature] Lite subgraph (#22114)	5 years ago
Yiqun Liu	b1401fb74d	Remove subgraph_detector from inference/analysis to the common framework/ir directory. (#22094) ... test=develop	5 years ago
Michał Gallus	6192108408	[DNNL] 3D Fully-Connected (#21746)	5 years ago
Pei Yang	122b37ce62	make config option DisableGlogInfo() able to mute all inference logs (#21318) ... * make DisableGlogInfo able to mute all logs in inference.	5 years ago
GaoWei8	234060f88f	Add fc padding to improve mkl GEMM's performance when N and K are multiple of 128. (#20972) ... * Add fc padding to solve mkl performance test=develop * fix gpu pass and error information test=develop * fix fc_fuse_pass_test test=develop * fix error information test=develop * fix error information test=develop * fix name and add fc op padding test test=develop * fix attributes test=develop * optimize fc padding test=develop * fix test test=develop	5 years ago
zhouwei25	345b67b5e2	remove warning LNK4006 and warning LNK4221 (#21226)	5 years ago
Pei Yang	e89c16b90d	Bug Fix: Paddle-TRT cannot handle adaptive pooling in pool2d op converter and "num" attribute in split op converter (#20733) ... * fix pool2d trt converter, test=develop * add fix for split op converter, test=develop	5 years ago
Zhaolong Xing	e89b12884a	FIx C++ inference BUG: When open memory optim and enable trt subgraph at the same time, there is a bug (#19969) ... * fix memory optimization type test=develop * 1. fix BUG: open trt and memory optim will trigger bug. 2. Clean memory optim bug. test=develop	5 years ago
Pei Yang	baccd7e2ca	Add TRT input shape check between model and runtime (#19864) ... * add TRT shape check, test=develop * model_input_shape == runtime_input_shape, refine message, test=develop	6 years ago
Pei Yang	74812d1c90	Fix BUGS: paddle-TRT repeatedly sets weight_map and overdeletes repetitive_params (#19825) ... * fix trt bugs when sharing params, test=develop * add unittest for cascade_rcnn	6 years ago
Zhaolong Xing	110be57c1b	fix memory optimization type (#19781) ... test=develop	6 years ago
baojun	a3a4b6e570	Enable ngraph through build_strategy (#19266) ... * enable ngraph throught build_strategy test=develop * add unittest test=develop * put use_ngraph unconditional test=develop * remove paddle_enforce test=develop * remove paddle_enforce test=develop * fix copyright test=develop * limit for ngraph only test=develop	6 years ago
Yiqun Liu	c5548178b0	A a pass to enable the use of cudnn (#19346) ... * Add a interface to enable cudnn for inference. * Add cudnn_placement_pass. test=develop * Set the default value of cudnn_enabled_op_types to null. test=develop * Write the common basic class, placement_pass_base, to refine the codes. test=develop * Call EnableCUDNN in unittest. test=develop * Refine cudnn_placement_pass tester. * Enable the testing of cudnn_placement_pass in inference's unittest. test=develop * Add the check of op kernels. test=develop	6 years ago
Zhaolong Xing	76c95af000	Fix BUG: Mask RCNN inference diff When using AnalysisPredictor. (#19213) ... * fix mask rcnn bug: 1. affine channel fuse (diff) 2. condition block op (memory leak) 3. merge lod tensor op (diff) 4. memroy optim (diff) test=develop * fix ci aboud PADDLE_ENFOCE fix merge lod infer op ut test=develop	6 years ago
Zhaolong Xing	61238d31f7	Trt fp16 support (#18860) ... * Fix Mask rcnn predictor 1. refine memory optim algorithm to support the model with the block op. 2. output diff : modify the affine channel fuse 3. add condition_block_infer op add interface for setting trt calib table dir test=develop * add the missing files. test=develop * 1 add trt fp16 support test=develop	6 years ago
Tao Luo	076f833110	add config.SetMkldnnCacheCapacity api for mkldnn cache clear strategy (#18580) ... * add config.SetMkldnnCacheCapacity api for mkldnn cache clear strategy test=develop * enhance MkldnnPostReset test=develop * add comments for mkldnn_cache_capacity field test=develop	6 years ago
Zhaolong Xing	88b52a27fe	Inference: fix mask rcnn model diff, optim memory usage, memory leak. (#18532) ... * Fix Mask rcnn predictor 1. refine memory optim algorithm to support the model with the block op. 2. output diff : modify the affine channel fuse 3. add condition_block_infer op add interface for setting trt calib table dir test=develop * add the missing files. test=develop	6 years ago
Wojciech Uss	c26130f3a9	reuse C-API INT8 unit test application (#18077) ... * reuse C-API INT8 unit test application test=develop * updates after review test=develop	6 years ago
石晓伟	bce259e5bf	Update the Anakin interfaces for content-dnn and MLU (#17890) ... * update anakin-engine interfaces for content-dnn test=develop * support only-gpu mode of Anakin modify eltwise parse test=develop * modification for thread-safe test=develop * Integrated template instance test=develop * increase template parameters test=develop * support MLU predictor test=develop * update anakin cmake files test=develop * update TargetWrapper::set_device * update the initialization of anakin subgraph test=develop * use the default constructor of base class test=develop	6 years ago
Zhaolong Xing	4e8d5a034f	Light mem reuse strategy for inference. (#17925) ... * fix: when use the load model from memory mode, the RAM occupy is high test=develop * ligth mem reuse test=develop * fix cpplint test=develop	6 years ago
Zhaolong Xing	ae576f3c68	fix: when use the load model from memory mode, the RAM occupy is high (#17788) ... test=develop	6 years ago
mozga-intel	5eb81fe595	Capi for a ngraph engine (#17037)	6 years ago
Zhaolong Xing	61221ebc28	TRT: Support set dynamic range in int8 mode. (#17524) ... * fluid int8 train and trt int8 predict align. trt int8 predict init op converter * 2. align fluid int8 train and trt int8 inference. enhance quant dequant fuse pass enhance op converter, trt engine, trt engine op, trt subgraph pass. * 3. add delete_quant_dequant_pass for trt test=develop * 4. add the missing file test=develop * 5. i modify the c++ interface, but forget to modify the pybind code fix the IS_TRT_VERSION_GE bug, and fix elementwise op converter test=develop	6 years ago