52 Commits (develop)

Author	SHA1	Message	Date
Wilber	f4d9212de2	trt plugin upgrade to pluginv2ext (#31670)	5 years ago
Wilber	01ccfbcde9	update trt error message when input height or width is -1 (#31019)	5 years ago
Shang Zhizhou	ae0f88a988	add DLA support：C++&&Python api (#30165) ... * add dla * add dla done * add python api Co-authored-by: shangzhizhou <root@szth-rp-fanyi-opera49.szth.baidu.com>	5 years ago
Shang Zhizhou	ea851796e5	TensorRT中ernie模型推理性能优化，支持变长输入 (#28367) ... * fp16 result ok * change -DWITH_NVINFER_PLUGIN toconfig.EnableTensorRtOSS * auto detect special slice op converter for ernie with trt oss * ernie oss only support fp16 * fix special_slice_plugin serialize bug * matmul in tensorrt ok * ernie unittest ok * add matmul tensorrt unittest * remove demo code	6 years ago
wanghuancoder	df43905f12	use iwyu clean include (#27267) ... * use iwyu clean include, test=develop, test=win * compilation error, test=develop * fix compilation error2, test=develop * fix compilation error3, test=develop * fix compilation error4, test=develop * fix compilation error5, test=develop * fix compilation error6, test=develop * fix compilation error7, test=develop * fix compilation error8, test=develop * fix compilation error8, test=develop * fix compilation error10, test=develop * fix compilation error11, test=develop	6 years ago
Pei Yang	aae41c6fca	refine error message related to paddle-TRT (#27256)	6 years ago
Zhaolong Xing	b7a86e92a8	fix dy shape bug in trt7.1 (#26273) ... test=develop	6 years ago
Pei Yang	b717895f64	Fix registering trt plugin (#25744) ... * develop dynamic shape serilization * add test param for gelu * fix bugs * delete redundant comments * debug * fix conflict. test=develop * fix bug. test=develop * add trt dynamic shape serialized support * fix ernie serialized bug test=develop * fix codestyle test=develop * fix bug test=develop * fix bug.test=develop * modify cmakelist test=develop * fix bug test=develop * fix error message. test=develop * fix trt register plugin based on pr#25003 * add trt dynload * fix deserialization bug of not finding plugin registration * refine code style * recover engine key in tensorrt_subgraph_pass * for ci coverage * add unittest for deserialization Co-authored-by: haozech <chenhaoze94@gmail.com>	6 years ago
Jeng Bai-Cheng	bef4afa6de	bugfix for unique_ptr of IOptimizationProfile (#23917) ... This commit fixs the compiling bug regarding unique_ptr of IOptimizationProfile. IOptimizationProfile has protected dtor and is controlled by TensorRT internally. Application shouldn't delete the pointer of IOptimizationProfile. See TensorRT document: https://docs.nvidia.com/deeplearning/sdk/tensorrt-api/c_api/classnvinfer1_1_1_i_builder.html#a9ac47e100454151d8206ac91d543299a test=develop	6 years ago
Zhaolong Xing	430b0099c9	[Paddle-TRT]: Ernie Dynamic shape support. (#23138) ... * add dynamic plugin support. test=develop * change emb eltwise layernorm to math function test=develop * add emb eltwise layernorm test=develop * can run dynamic shape ernie test=develop * fix ci test=develop * add ut for trt ernie dynamic test=develop * refine dynamic shape c++ interface. test=develop * fix comments test=develop * fix comments test=develop	6 years ago
Zhaolong Xing	dd67d44a50	[Paddle-TRT] : (Part1) Dynamic shape support (#22868) ... * change the ci trt from version 5. to 6.0 * paddle-trt dynamic shape support init * conv+bias or conv+bn dynamic shape support test=develop * modity trt engine opconvert test=develop * fix ci error test=develop	6 years ago
Zhaolong Xing	ceda0b9b1a	[Fix BUG]: Core when multi thread + clone + paddle-trt (#22442) ... * add mutex for trt engine test=develop * add the test for copy_to_cpu test=develop	6 years ago
Pei Yang	2e2f92a5b1	fix trt weight bug (#21231) ... added splitter "__" between weight name and suffix number to avoid conflicts.	7 years ago
Pei Yang	74812d1c90	Fix BUGS: paddle-TRT repeatedly sets weight_map and overdeletes repetitive_params (#19825) ... * fix trt bugs when sharing params, test=develop * add unittest for cascade_rcnn	7 years ago
石晓伟	d004a0f50e	fix multi-thread exec of trt, test=develop (#19338)	7 years ago
wopeizl	80b7ef6fc8	add tensorrt support for windows (#19084) ... * add tensorrt support for windows	7 years ago
Zhaolong Xing	61238d31f7	Trt fp16 support (#18860) ... * Fix Mask rcnn predictor 1. refine memory optim algorithm to support the model with the block op. 2. output diff : modify the affine channel fuse 3. add condition_block_infer op add interface for setting trt calib table dir test=develop * add the missing files. test=develop * 1 add trt fp16 support test=develop	7 years ago
Zhaolong Xing	ae576f3c68	fix: when use the load model from memory mode, the RAM occupy is high (#17788) ... test=develop	7 years ago
Zhaolong Xing	61221ebc28	TRT: Support set dynamic range in int8 mode. (#17524) ... * fluid int8 train and trt int8 predict align. trt int8 predict init op converter * 2. align fluid int8 train and trt int8 inference. enhance quant dequant fuse pass enhance op converter, trt engine, trt engine op, trt subgraph pass. * 3. add delete_quant_dequant_pass for trt test=develop * 4. add the missing file test=develop * 5. i modify the c++ interface, but forget to modify the pybind code fix the IS_TRT_VERSION_GE bug, and fix elementwise op converter test=develop	7 years ago
nhzlx	0ed63b2108	6. delete useless predictor id ... test=develop	7 years ago
nhzlx	1d5ef7c9ee	5. add static trt load model ... 1). add static trt load model 2). fix bug: when device_id is not 0, the trt will have a bug test=develop	7 years ago
nhzlx	2070fb246d	4. do the trt_engine optim during init. ... add simple static mode loading test=develop	7 years ago
nhzlx	9cc6249cd6	2. TRTEngine using stream only when execute.	7 years ago
nhzlx	034ba1c291	add static model load for trt ... 1. bind trt input and output to fluid tensors	7 years ago
nhzlx	027d24c831	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into trt_int8_ultimate_version	7 years ago
nhzlx	ec213730bc	fix trt stream bug. ... BUG: After continuing to input different data, the output cannot be aligned test=develop	7 years ago
nhzlx	8817841c73	fix unit test bug ... test=develop	7 years ago
nhzlx	312fe0ece1	add trt int8 calibration support ... fix comments test=develop	7 years ago
nhzlx	4e3522e5b4	add trt int8 support ... test=develop	7 years ago
Yiqun Liu	8bc1c5d2ab	Implement the Tensorrt plugin for elementwise op (#14487) ... * Initialize the elementwise plugin. * Implement the basic CUDA kernel of elementwise plugin. test=develop	8 years ago
hjchen2	6a7b995737	Refine commit message to enable ci, test=develop	8 years ago
hjchen2	21f33b4274	Complete PRelu plugin and Conv2d transpose op converter	8 years ago
nhzlx	0b96268057	fix comments ... test=develop	8 years ago
nhzlx	d38fd6a0fc	add plugin support and offer an simple split sample	8 years ago
qingqing01	abe209234f	Exhaustive search for cuDNN conv. (#14286) ... * exhaustive search for cuDNN conv. * Refine code and add unit testing. * Fix model load in fluid/inference and unit testing in conv2d * Follow comments. * Fix compiling test=develop	8 years ago
nhzlx	86b99ac953	fix comments and fix bug	8 years ago
nhzlx	849a6874ad	fix googlenet bug with relu	8 years ago
nhzlx	1600ba86f6	1. change tensorrt op from cpu to gpu	8 years ago
nhzlx	bcd67bdd71	add assert for GetOutput	8 years ago
nhzlx	f42ea48996	deal with conflict	8 years ago
nhzlx	2372daff1d	there is no batchsize concept in tensorrt's tensor	8 years ago
Yan Chunwei	b42ced8eda	bugfix/tensorrt analysis fix subgraph trigger (#12266)	8 years ago
Yan Chunwei	5fd142c3fd	bugfix/trt engine op (#11487)	8 years ago
Yan Chunwei	4f95bc9463	feature/trt engine op test (#11182)	8 years ago
Yan Chunwei	0c0c5df4cb	feature/add TRT fc converter (#11043)	8 years ago
Yan Chunwei	211e131525	feature/tensorrt engine op (#11001)	8 years ago
Yan Chunwei	819038113e	Feature/engine refactor (#10497) ... * init refactor * init * update some comment * fix build * fix errorrr * fix bug * fix comment * update	8 years ago
Tao Luo	4646c0f35d	Merge pull request #10144 from luotao1/tr_convert_init ... tensorrt convert init	8 years ago
Luo Tao	beb1245560	add relu converter and unit-test	8 years ago
Abhinav Arora	55f0d84029	Fix Cpplint Issues in fluid/inference/tensorrt/ (#10318) ... * Fix CPPLint issues in fluid/inference/tensorrt/ * Fix compile errors	8 years ago