73 Commits (7043b8cfc67989720e4fb53bcb43fa20ea98ca73)

Author	SHA1	Message	Date
Shang Zhizhou	05b27695f1	add inference api： DisableTensorRtOps (#30109) ... * snap * add inference api: DisableTensorRtOPs * fix code style * update api to experimental * update variable name	5 years ago
ceci3	85b2f05ab0	register ModifyAttr for instance_norm, test=op_version (#30065) ... * register instance norm, test=op_version	5 years ago
Wilber	66e16b7e99	update lite subgraph. (#30056)	5 years ago
wawltor	cc2f94620c	add the support the op version check for matmul, test=op_version (#30011) ... * add the support the op version check for matmul, test=op_version	5 years ago
wawltor	b33aaea86c	add the op version check for the elementwise ops, test=op_version (#30010) ... * add the op version check for the elementwise ops, test=op_version * add the support check for elementwise_ops, test=op_version	5 years ago
Shang Zhizhou	ebf689197d	fix tensorrt output shape error (#29308) ... * fix tensorrt output shape error * fix unittest tensorrt_engine_op_test * fix code style for unitest	5 years ago
Leo Chen	90805e2df7	Register op_version for new attribute use_addto (#28463) ... * register op_version for addto * upgrade pass capability * change eq to le * change eq to le * fix merge	5 years ago
Shang Zhizhou	8699f38d08	裁剪transformer模型trt支持；修复tensorRT不支持DeletePass的bug (#28517) ... * skip_layernorm_op done * add unittest * slice op convertor support trt < 6 * skip_layernorm only work in ernie	5 years ago
Shang Zhizhou	ea851796e5	TensorRT中ernie模型推理性能优化，支持变长输入 (#28367) ... * fp16 result ok * change -DWITH_NVINFER_PLUGIN toconfig.EnableTensorRtOSS * auto detect special slice op converter for ernie with trt oss * ernie oss only support fp16 * fix special_slice_plugin serialize bug * matmul in tensorrt ok * ernie unittest ok * add matmul tensorrt unittest * remove demo code	5 years ago
Wilber	9005c5a260	Lite subgraph support arm cpu. (#27827)	5 years ago
Pei Yang	ae6e40a7fd	Add unittests and OP version registry for tensorrt_subgraph_pass (#27544) ... * add unittests and op version register for tensorrt_subgraph_pass * rename to test_trt_subgraph_pass.py * fix softmax converter diff when padding dim=1	5 years ago
wanghuancoder	df43905f12	use iwyu clean include (#27267) ... * use iwyu clean include, test=develop, test=win * compilation error, test=develop * fix compilation error2, test=develop * fix compilation error3, test=develop * fix compilation error4, test=develop * fix compilation error5, test=develop * fix compilation error6, test=develop * fix compilation error7, test=develop * fix compilation error8, test=develop * fix compilation error8, test=develop * fix compilation error10, test=develop * fix compilation error11, test=develop	5 years ago
Wilber	dae62556cb	Enhance infer error info message (#26731)	5 years ago
Wilber	1b84c0bf43	Lite subgraph refine predictor (#27167)	5 years ago
石晓伟	7206417259	supports xpu runtime, test=develop (#25554) ... * update ResetHolder, test=develop * add TensorShare for lite engine, test=develop * tensor data changed from copying to sharing, test=develop * supports xpu runtime, test=develop * fix code styles, test=develop	5 years ago
Shibo Tao	19c4db1b56	don't re-generate header file if content doesn't change (#25130) ... * don't re-generate header file if content doesn't change. test=develop * add copy_if_different function. test=develop	5 years ago
Chen Weihang	aa0f254fbe	Add macro BOOST_GET to enrich the error information of boost :: get (#24175) ... * add new macro BOOST_GET_SAFELY & unittests, test=develop * add different macro type, test=develop * fix get macro type in executor, test=develop * four macro part change backup * using one macro for all case, test=develop * revert attribute change, test=develop * change to three func to solve gcc4.8 bug, test=develop * polish some details, test=develop	5 years ago
Zhaolong Xing	430b0099c9	[Paddle-TRT]: Ernie Dynamic shape support. (#23138) ... * add dynamic plugin support. test=develop * change emb eltwise layernorm to math function test=develop * add emb eltwise layernorm test=develop * can run dynamic shape ernie test=develop * fix ci test=develop * add ut for trt ernie dynamic test=develop * refine dynamic shape c++ interface. test=develop * fix comments test=develop * fix comments test=develop	5 years ago
Zhaolong Xing	dd67d44a50	[Paddle-TRT] : (Part1) Dynamic shape support (#22868) ... * change the ci trt from version 5. to 6.0 * paddle-trt dynamic shape support init * conv+bias or conv+bn dynamic shape support test=develop * modity trt engine opconvert test=develop * fix ci error test=develop	5 years ago
tianshuo78520a	d2ba91aad1	fix typo words (#22653)	5 years ago
Zhaolong Xing	54a325a52f	[Refine Paddle-TRT INT8]: Support PaddleSlim's Resnet50, Mobilenetv1, Yolov3 models for Inference. (#22483) ... * add int8 op teller for trt. * refine trt int8 * add int8 op teller for trt. test=develop	5 years ago
石晓伟	e1b0d7cbb1	remove anakin from code, test=develop (#22420)	5 years ago
石晓伟	ad0dfb17c1	[Feature] Lite subgraph (#22114)	6 years ago
Yiqun Liu	b1401fb74d	Remove subgraph_detector from inference/analysis to the common framework/ir directory. (#22094) ... test=develop	6 years ago
Pei Yang	122b37ce62	make config option DisableGlogInfo() able to mute all inference logs (#21318) ... * make DisableGlogInfo able to mute all logs in inference.	6 years ago
Pei Yang	e89c16b90d	Bug Fix: Paddle-TRT cannot handle adaptive pooling in pool2d op converter and "num" attribute in split op converter (#20733) ... * fix pool2d trt converter, test=develop * add fix for split op converter, test=develop	6 years ago
Zhaolong Xing	e89b12884a	FIx C++ inference BUG: When open memory optim and enable trt subgraph at the same time, there is a bug (#19969) ... * fix memory optimization type test=develop * 1. fix BUG: open trt and memory optim will trigger bug. 2. Clean memory optim bug. test=develop	6 years ago
Pei Yang	baccd7e2ca	Add TRT input shape check between model and runtime (#19864) ... * add TRT shape check, test=develop * model_input_shape == runtime_input_shape, refine message, test=develop	6 years ago
Pei Yang	74812d1c90	Fix BUGS: paddle-TRT repeatedly sets weight_map and overdeletes repetitive_params (#19825) ... * fix trt bugs when sharing params, test=develop * add unittest for cascade_rcnn	6 years ago
baojun	a3a4b6e570	Enable ngraph through build_strategy (#19266) ... * enable ngraph throught build_strategy test=develop * add unittest test=develop * put use_ngraph unconditional test=develop * remove paddle_enforce test=develop * remove paddle_enforce test=develop * fix copyright test=develop * limit for ngraph only test=develop	6 years ago
Zhaolong Xing	61238d31f7	Trt fp16 support (#18860) ... * Fix Mask rcnn predictor 1. refine memory optim algorithm to support the model with the block op. 2. output diff : modify the affine channel fuse 3. add condition_block_infer op add interface for setting trt calib table dir test=develop * add the missing files. test=develop * 1 add trt fp16 support test=develop	6 years ago
Zhaolong Xing	88b52a27fe	Inference: fix mask rcnn model diff, optim memory usage, memory leak. (#18532) ... * Fix Mask rcnn predictor 1. refine memory optim algorithm to support the model with the block op. 2. output diff : modify the affine channel fuse 3. add condition_block_infer op add interface for setting trt calib table dir test=develop * add the missing files. test=develop	6 years ago
石晓伟	bce259e5bf	Update the Anakin interfaces for content-dnn and MLU (#17890) ... * update anakin-engine interfaces for content-dnn test=develop * support only-gpu mode of Anakin modify eltwise parse test=develop * modification for thread-safe test=develop * Integrated template instance test=develop * increase template parameters test=develop * support MLU predictor test=develop * update anakin cmake files test=develop * update TargetWrapper::set_device * update the initialization of anakin subgraph test=develop * use the default constructor of base class test=develop	6 years ago
Zhaolong Xing	ae576f3c68	fix: when use the load model from memory mode, the RAM occupy is high (#17788) ... test=develop	6 years ago
mozga-intel	5eb81fe595	Capi for a ngraph engine (#17037)	6 years ago
Zhaolong Xing	61221ebc28	TRT: Support set dynamic range in int8 mode. (#17524) ... * fluid int8 train and trt int8 predict align. trt int8 predict init op converter * 2. align fluid int8 train and trt int8 inference. enhance quant dequant fuse pass enhance op converter, trt engine, trt engine op, trt subgraph pass. * 3. add delete_quant_dequant_pass for trt test=develop * 4. add the missing file test=develop * 5. i modify the c++ interface, but forget to modify the pybind code fix the IS_TRT_VERSION_GE bug, and fix elementwise op converter test=develop	6 years ago
石晓伟	a72dbe9abf	Cherry-pick benchmark related changes from release/1.4 (#17156) ... * cherry-pick commit from 8877054 * cherry-pick commit from 3f0b97d * cherry-pick from 16691:Anakin subgraph support yolo_v3 and faster-rcnn (cherry picked from commit 8643dbc233) * Cherry-Pick from 16662 : Anakin subgraph cpu support (cherry picked from commit 7ad182e16c) * Cherry-pick from 1662, 16797.. : add anakin int8 support (cherry picked from commit e14ab180fe) * Cherry-pick from 16813 : change singleton to graph RegistBlock test=release/1.4 (cherry picked from commit 4b9fa42307) * Cherry Pick : 16837 Support ShuffleNet and MobileNet-v2 Support ShuffleNet and MobileNet-v2, test=release/1.4 (cherry picked from commit a6fb066f90) * Cherry-pick : anakin subgraph add opt config layout argument #16846 test=release/1.4 (cherry picked from commit 8121b3eccb) * 1. add shuffle_channel_detect (cherry picked from commit 6efdea8997) * update shuffle_channel op convert, test=release/1.4 (cherry picked from commit e4726a066f) * Modify symbol export rules test=develop	6 years ago
石晓伟	5dea0bdd1b	Merge pull request #16498 from Shixiaowei02/feature/anakin-engine ... merge feature/anakin-engine to develop	6 years ago
Shixiaowei02	7b9fc71076	update tensorrt subgraph_util test=develop	6 years ago
Shixiaowei02	bddb2cd315	resolve conflicts with the develop branch test=develop	6 years ago
nhzlx	d065b5bf2b	Anakin ssd support ... refine trt first run add quant dequant fuse pass omit simplify_anakin_priorbox_detection template omit transpose_flatten_concat_fuse template test=develop	6 years ago
chengduo	ed61d67c73	Fix the interface of Pass::Apply (#16484) ... * modify the interface of Pass::Allay test=develop * Polish code test=develop * Fix Travis CI test=develop * fix Pass::Apply interface test=develop * Fix Travis CI test=develop	6 years ago
nhzlx	f3a2e4b3d8	1. Add ANAKIN_ROOT compile option ... 2. refine trt code test=develop	6 years ago
nhzlx	07dcf2856c	git cherry-pick from feature/anakin-engine: update anakin subgraph #16278	6 years ago
nhzlx	a25331bc26	cherry-pick from feature/anakin-engine: deal the changing shape when using anakin #16189	6 years ago
nhzlx	c79f06d3d8	cherry-pick from feature/anakin-engine: add batch interface for pd-anakin #16178	6 years ago
nhzlx	69d37f81d7	cherry-pick from feature/anakin-engine: refine anakin subgraph. #16157 ... support change input size	6 years ago
nhzlx	a1d200a5de	cherry-pick from feature/anakin-engine: Anakin support facebox #16111	6 years ago
nhzlx	b21770a2aa	cherry-pick from feature/anakin-engine: Add subgraph fuse support and anakin engine #16018	6 years ago
nhzlx	a9ed427749	cant not pass ci ... add if use static engine for trt test=develop	6 years ago