62 Commits (ae0f88a988a1b1e53168a6108484d0cfdcb58003)

Author	SHA1	Message	Date
Shang Zhizhou	ae0f88a988	add DLA support：C++&&Python api (#30165) ... * add dla * add dla done * add python api Co-authored-by: shangzhizhou <root@szth-rp-fanyi-opera49.szth.baidu.com>	4 years ago
Shang Zhizhou	05b27695f1	add inference api： DisableTensorRtOps (#30109) ... * snap * add inference api: DisableTensorRtOPs * fix code style * update api to experimental * update variable name	4 years ago
Shang Zhizhou	ea851796e5	TensorRT中ernie模型推理性能优化，支持变长输入 (#28367) ... * fp16 result ok * change -DWITH_NVINFER_PLUGIN toconfig.EnableTensorRtOSS * auto detect special slice op converter for ernie with trt oss * ernie oss only support fp16 * fix special_slice_plugin serialize bug * matmul in tensorrt ok * ernie unittest ok * add matmul tensorrt unittest * remove demo code	5 years ago
joanna.wozna.intel	ddcd1b5381	Add bfloat16 resnet50 test (#27755)	5 years ago
Wilber	dae62556cb	Enhance infer error info message (#26731)	5 years ago
Wilber	1b84c0bf43	Lite subgraph refine predictor (#27167)	5 years ago
石晓伟	7206417259	supports xpu runtime, test=develop (#25554) ... * update ResetHolder, test=develop * add TensorShare for lite engine, test=develop * tensor data changed from copying to sharing, test=develop * supports xpu runtime, test=develop * fix code styles, test=develop	5 years ago
Zhaolong Xing	430b0099c9	[Paddle-TRT]: Ernie Dynamic shape support. (#23138) ... * add dynamic plugin support. test=develop * change emb eltwise layernorm to math function test=develop * add emb eltwise layernorm test=develop * can run dynamic shape ernie test=develop * fix ci test=develop * add ut for trt ernie dynamic test=develop * refine dynamic shape c++ interface. test=develop * fix comments test=develop * fix comments test=develop	5 years ago
Zhaolong Xing	dd67d44a50	[Paddle-TRT] : (Part1) Dynamic shape support (#22868) ... * change the ci trt from version 5. to 6.0 * paddle-trt dynamic shape support init * conv+bias or conv+bn dynamic shape support test=develop * modity trt engine opconvert test=develop * fix ci error test=develop	5 years ago
GaoWei8	cdf5f6fb8c	Add an inference interface to disable FC padding (#22097) ... * Add an interface of disabling FC padding * fix bert regression * polish fc padding interface * recover pass function * fix argument error * fix mkldnn error	5 years ago
石晓伟	e1b0d7cbb1	remove anakin from code, test=develop (#22420)	5 years ago
石晓伟	ad0dfb17c1	[Feature] Lite subgraph (#22114)	5 years ago
Pei Yang	122b37ce62	make config option DisableGlogInfo() able to mute all inference logs (#21318) ... * make DisableGlogInfo able to mute all logs in inference.	6 years ago
Zhaolong Xing	e89b12884a	FIx C++ inference BUG: When open memory optim and enable trt subgraph at the same time, there is a bug (#19969) ... * fix memory optimization type test=develop * 1. fix BUG: open trt and memory optim will trigger bug. 2. Clean memory optim bug. test=develop	6 years ago
Zhaolong Xing	76c95af000	Fix BUG: Mask RCNN inference diff When using AnalysisPredictor. (#19213) ... * fix mask rcnn bug: 1. affine channel fuse (diff) 2. condition block op (memory leak) 3. merge lod tensor op (diff) 4. memroy optim (diff) test=develop * fix ci aboud PADDLE_ENFOCE fix merge lod infer op ut test=develop	6 years ago
Tao Luo	076f833110	add config.SetMkldnnCacheCapacity api for mkldnn cache clear strategy (#18580) ... * add config.SetMkldnnCacheCapacity api for mkldnn cache clear strategy test=develop * enhance MkldnnPostReset test=develop * add comments for mkldnn_cache_capacity field test=develop	6 years ago
Zhaolong Xing	88b52a27fe	Inference: fix mask rcnn model diff, optim memory usage, memory leak. (#18532) ... * Fix Mask rcnn predictor 1. refine memory optim algorithm to support the model with the block op. 2. output diff : modify the affine channel fuse 3. add condition_block_infer op add interface for setting trt calib table dir test=develop * add the missing files. test=develop	6 years ago
Zhaolong Xing	ae576f3c68	fix: when use the load model from memory mode, the RAM occupy is high (#17788) ... test=develop	6 years ago
Zhaolong Xing	61221ebc28	TRT: Support set dynamic range in int8 mode. (#17524) ... * fluid int8 train and trt int8 predict align. trt int8 predict init op converter * 2. align fluid int8 train and trt int8 inference. enhance quant dequant fuse pass enhance op converter, trt engine, trt engine op, trt subgraph pass. * 3. add delete_quant_dequant_pass for trt test=develop * 4. add the missing file test=develop * 5. i modify the c++ interface, but forget to modify the pybind code fix the IS_TRT_VERSION_GE bug, and fix elementwise op converter test=develop	6 years ago
石晓伟	a72dbe9abf	Cherry-pick benchmark related changes from release/1.4 (#17156) ... * cherry-pick commit from 8877054 * cherry-pick commit from 3f0b97d * cherry-pick from 16691:Anakin subgraph support yolo_v3 and faster-rcnn (cherry picked from commit 8643dbc233) * Cherry-Pick from 16662 : Anakin subgraph cpu support (cherry picked from commit 7ad182e16c) * Cherry-pick from 1662, 16797.. : add anakin int8 support (cherry picked from commit e14ab180fe) * Cherry-pick from 16813 : change singleton to graph RegistBlock test=release/1.4 (cherry picked from commit 4b9fa42307) * Cherry Pick : 16837 Support ShuffleNet and MobileNet-v2 Support ShuffleNet and MobileNet-v2, test=release/1.4 (cherry picked from commit a6fb066f90) * Cherry-pick : anakin subgraph add opt config layout argument #16846 test=release/1.4 (cherry picked from commit 8121b3eccb) * 1. add shuffle_channel_detect (cherry picked from commit 6efdea8997) * update shuffle_channel op convert, test=release/1.4 (cherry picked from commit e4726a066f) * Modify symbol export rules test=develop	6 years ago
Shixiaowei02	bddb2cd315	resolve conflicts with the develop branch test=develop	6 years ago
nhzlx	953bdde058	Merge branch 'develop' of https://github.com/paddlepaddle/paddle into HEAD ... test=develop	6 years ago
Wojciech Uss	46677fb080	Move cpu_quantize_* passes into mkldnn subfolder ... test=develop	6 years ago
nhzlx	3df7b98a0f	Merge branch 'develop' of https://github.com/paddlepaddle/paddle into HEAD	6 years ago
Wojciech Uss	cbe2dbf0db	Add enabling quantization (#16326) ... * Add enabling quantization test=develop * remove unused (here) function	6 years ago
nhzlx	a25331bc26	cherry-pick from feature/anakin-engine: deal the changing shape when using anakin #16189	6 years ago
nhzlx	c79f06d3d8	cherry-pick from feature/anakin-engine: add batch interface for pd-anakin #16178	6 years ago
nhzlx	69d37f81d7	cherry-pick from feature/anakin-engine: refine anakin subgraph. #16157 ... support change input size	6 years ago
Wojciech Uss	2579ade45f	Add cpu_quantize_pass for C-API quantization (#16127) ... * Add cpu_quantize_pass for C-API quantization test=develop * add cpu_quantize_pass test * fix lint: add include memory unorderd_map and unordered_set test=develop * fuse_relu 1 test=develop * tuned 2 without squash * fixes test=develop * remove unused vars test=develop * refactored test=develop * fix lint c-style cast -> C++ style cast test=develop * remove QuantMax and c style casts test=develop * last usage of QuantMax removed test=develop * Fix Analysis Predictor UT Check if memory_optimize_pass has already been added to the analysis config before adding a new one, so that it is not added multiple times. test=develop * change map to unordered_map fix the forgotten part of cpu_quantize_pass_tester.cc test=develop * removed quantized attribute * fixed cpu_quantize_pass_tester and op attr comments test=develop * removed redundant line test=debug * removed gmock test=develop * fix after merge	6 years ago
nhzlx	a9ed427749	cant not pass ci ... add if use static engine for trt test=develop	6 years ago
nhzlx	0ed63b2108	6. delete useless predictor id ... test=develop	6 years ago
nhzlx	2070fb246d	4. do the trt_engine optim during init. ... add simple static mode loading test=develop	6 years ago
Yan Chunwei	655179089f	AnalysisConfig remove contrib namespace (#15540)	6 years ago
Zhaolong Xing	97b76c94c4	Merge pull request #15242 from NHZlX/trt_int8_ultimate_version ... add trt int8 support	6 years ago
Yan Chunwei	e2818c8608	add dynamic memory optim (#15457)	6 years ago
nhzlx	92cf4a4c6b	fix comments ... test=develop	6 years ago
nhzlx	027d24c831	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into trt_int8_ultimate_version	6 years ago
Yan Chunwei	885c4e57ab	fea/infer memory optim2 (#14953)	6 years ago
nhzlx	312fe0ece1	add trt int8 calibration support ... fix comments test=develop	6 years ago
nhzlx	4e3522e5b4	add trt int8 support ... test=develop	7 years ago
Yan Chunwei	6ccf8685f7	refactor tensorrt node teller (#15181)	7 years ago
nhzlx	71636e677d	add min_subgraph_size attr to tensorrt config ... test=develop	7 years ago
bingyanghuang	943ad4781f	One possible solution to add flexibility for mkldnn placement pass (#14768) ... * Choose to turn on use_mkldnn attribute v1 * Fix mkldnn_op empty bug * format change test=develop * fix ci test=develop * fix ci test and add test in dam test=develop * add example to dam compare test test=develop * review changes test=develop	7 years ago
Tao Luo	743cb840f1	update with comments ... test=develop	7 years ago
Tao Luo	405b2486db	support loading from memory ... test=develop	7 years ago
superjomn	4bf6817cbc	fix gpu load model ... the parameters will load from CPUPlace, that will keep copying data between CPU and GPU places. test=develop	7 years ago
Yan Chunwei	9f252e0032	Combine Inference Analysis with IR (#13914)	7 years ago
minqiyang	87450b9ad4	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into fix_vlog ... test=develop	7 years ago
Zhaolong Xing	ba8b5619a3	Revert "cherry picked windows patches."	7 years ago
minqiyang	fcc0452c8b	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into fix_vlog ... test=develop	7 years ago