212 Commits (d5e40d1ba911a35f1094e9d04260e6c8d85fa68b)

Author	SHA1	Message	Date
Pei Yang	b2f5a149e7	[Paddle-TRT] Better Paddle-TensorRT support for PaddleSlim quant models (#25097) ... * Paddle-TensorRT support slim QAT. test=develop * add comments. test=develop * use RenameInput instead of ResetInputs. test=develop	5 years ago
Zhaolong Xing	843581154f	fix emb eltwise layernorm (#24873) ... test=develop	5 years ago
Leo Chen	fa657b3dbb	fix bug of prelu when rank not equal 4, test=develop (#25067) ... * fix bug of prelu when rank not equal 4, test=develop * fix prelu inference, test=develop * fix api, test=develop * fix shape when mode is chennel, test=develop * remove debug code, test=develop * add unittest, test=develop	5 years ago
Jeng Bai-Cheng	bef4afa6de	bugfix for unique_ptr of IOptimizationProfile (#23917) ... This commit fixs the compiling bug regarding unique_ptr of IOptimizationProfile. IOptimizationProfile has protected dtor and is controlled by TensorRT internally. Application shouldn't delete the pointer of IOptimizationProfile. See TensorRT document: https://docs.nvidia.com/deeplearning/sdk/tensorrt-api/c_api/classnvinfer1_1_1_i_builder.html#a9ac47e100454151d8206ac91d543299a test=develop	5 years ago
zlsh80826	49e4ee27e1	[Paddle-TRT] slice kernel optimization (#24783) ... * parallel move shared data test=develop * test=develop	5 years ago
Chen Weihang	d1062d5278	Replace all errors thrown by LOG(FATAL) with PADDLE_THROW (#24759) ... * remove REPLACE_ENFORCE_GLOG compile option & add ci rule prohibit LOG(FATAL) using, test=develop * remove ci test case, test=develop * replace all LOG(FATAL) & polish message, test=develop * fix typo, test=develop * polish error info detail, test=develop	5 years ago
Pei Yang	181b1f5a30	adjust minimum trt version for hard_sigmoid converter to 5130. test=develop (#24746)	5 years ago
zlsh80826	fdbe114b12	[Paddle-TRT] use float constant instead of double test=develop (#24544)	5 years ago
Zhaolong Xing	f68d4fb3f1	fix bert bug using trt6 when compile with CUDA_ARCH_NAME=All (#24517) ... test=develop	5 years ago
Chen Weihang	aa0f254fbe	Add macro BOOST_GET to enrich the error information of boost :: get (#24175) ... * add new macro BOOST_GET_SAFELY & unittests, test=develop * add different macro type, test=develop * fix get macro type in executor, test=develop * four macro part change backup * using one macro for all case, test=develop * revert attribute change, test=develop * change to three func to solve gcc4.8 bug, test=develop * polish some details, test=develop	5 years ago
Zhaolong Xing	35148d17f7	[BUG]: Head number can only be > 1 on multihead op (#23974) ... * support the head number == 1 test=develop * fix slice op error. test=develop	5 years ago
Zhou Wei	7817003795	Optimize the error messages of paddle CUDA API (#23816) ... * Optimize the error messages of paddle CUDA API, test=develop * fix the error messages of paddle CUDA API, test=develop * Refactoring PADDLE_ENFORCE_CUDA_SUCCESS, and apply to curand/cudnn/cublas/NCCL,test=develop * remove build_ex_string,test=develop * merge conflict,test=develop	5 years ago
Zhaolong Xing	133f1fc123	[Eernie TRT]: add slice op and add emb eltwise layernorm fp16 support (#23723) ... * refine ernie trt dynamic shape support 1. add slice op converter 2. add emb eltwise layernorm fp16 support test=develop * fix dynamic shape test ut test=develop * fix comments. test=develop * fix comments test=develop	5 years ago
chenhaoze	b7d185d6ca	OP clip, merge_lod_tensor, convert/elementwise error message enhancement (#23742) ... * OP clip, merge_lod_tensor, convert/elementwise error message enhancement. test=develop	5 years ago
Pei Yang	c528f1d4f3	[Paddle-TRT] Add hard_sigmoid and hard_swish support(support MobilenetV3) (#23672) ... * add hard_sigmoid trt op converter * add hard_swish op converter and plugin. test=develop * add macro to adapt lower trt version. test=develop	5 years ago
Pei Yang	015acdbfb1	Refine error message of leaky_relu, tensorrt_engine, split, prelu op converter (#23661)	5 years ago
Zhaolong Xing	3acb047a20	[Paddle-TRT]: add eltwise,pool2d, prelu, scale, concat, gelu dynamic shape support (#23396) ... * add elementwise pool2d, prelu, shuffle channel test=develop * add scale and refine concat eltwise conveter test=develop * refine elementwise converter test=develop * refine ut test and enforce error. test=develop * modify const cast test=develop	5 years ago
Zhaolong Xing	ed5766ffbc	refine act conv2d pool2d trt converter log (#23605) ... * refine act conv2d pool2d fc, trt converter log test=develop * fix comments test=develop	5 years ago
Pei Yang	28f04c6a5e	refine shuffle channel errmsg, test=develop (#23520)	5 years ago
Pei Yang	3d5d217030	Revert "[Paddle-TRT] Add hard_sigmoid and hard_swish support(support MobilenetV3) (#23536)", test=develop (#23642) ... This reverts commit cdc6d4e292.	5 years ago
Pei Yang	eb11633611	batch_norm trt converter error message, test=develop (#23620)	5 years ago
Pei Yang	cdc6d4e292	[Paddle-TRT] Add hard_sigmoid and hard_swish support(support MobilenetV3) (#23536) ... * add hard_sigmoid trt op converter * add hard_swish op converter and plugin. test=develop	5 years ago
Pei Yang	42655ef721	Add full_like op. (#23364) ... * add full_like op. test=develop * add dygraph support. test=develop * increase coverage. test=develop	5 years ago
Zhaolong Xing	1a6ce8b910	add swish split gelu plugin dynamic support (#23305) ... test=develop	5 years ago
Zhaolong Xing	430b0099c9	[Paddle-TRT]: Ernie Dynamic shape support. (#23138) ... * add dynamic plugin support. test=develop * change emb eltwise layernorm to math function test=develop * add emb eltwise layernorm test=develop * can run dynamic shape ernie test=develop * fix ci test=develop * add ut for trt ernie dynamic test=develop * refine dynamic shape c++ interface. test=develop * fix comments test=develop * fix comments test=develop	5 years ago
Pei Yang	24db750386	fix trt int8 calib precision bug. test=develop (#23036)	5 years ago
Zhaolong Xing	dd67d44a50	[Paddle-TRT] : (Part1) Dynamic shape support (#22868) ... * change the ci trt from version 5. to 6.0 * paddle-trt dynamic shape support init * conv+bias or conv+bn dynamic shape support test=develop * modity trt engine opconvert test=develop * fix ci error test=develop	5 years ago
tianshuo78520a	d2ba91aad1	fix typo words (#22653)	5 years ago
Zhaolong Xing	54a325a52f	[Refine Paddle-TRT INT8]: Support PaddleSlim's Resnet50, Mobilenetv1, Yolov3 models for Inference. (#22483) ... * add int8 op teller for trt. * refine trt int8 * add int8 op teller for trt. test=develop	5 years ago
Zhaolong Xing	ceda0b9b1a	[Fix BUG]: Core when multi thread + clone + paddle-trt (#22442) ... * add mutex for trt engine test=develop * add the test for copy_to_cpu test=develop	5 years ago
zhouwei25	549e6de7ac	faster build by reduce by-product, reduce linking library and fix compile warning of std=c++11 (#22164)	5 years ago
Pei Yang	d8a9b134e3	fix trt instance_norm serialize bug. test=develop (#22152)	5 years ago
Pei Yang	50bee83f71	add TRT support for instance_norm op (#21928) ... * add TRT support for instance_norm op	5 years ago
Pei Yang	0a51098a71	Add TRT support for BERT (#21135) ... * add gelu plugin * align trt bert with gpu * add support for fused fc with relu, * add unittest for bert trt	5 years ago
Zhaolong Xing	da7748c53d	add conv, depthwise_conv, pooling (#20966) ... test=develop	6 years ago
Pei Yang	2e2f92a5b1	fix trt weight bug (#21231) ... added splitter "__" between weight name and suffix number to avoid conflicts.	6 years ago
Zhaolong Xing	65f7052554	TRT int8: refine trt int8 for dynamic range set (#21112) ... * refine trt int8 for dynamic range set test=develop * refine trt int8 test=develop	6 years ago
Pei Yang	e89c16b90d	Bug Fix: Paddle-TRT cannot handle adaptive pooling in pool2d op converter and "num" attribute in split op converter (#20733) ... * fix pool2d trt converter, test=develop * add fix for split op converter, test=develop	6 years ago
Pei Yang	74812d1c90	Fix BUGS: paddle-TRT repeatedly sets weight_map and overdeletes repetitive_params (#19825) ... * fix trt bugs when sharing params, test=develop * add unittest for cascade_rcnn	6 years ago
石晓伟	d004a0f50e	fix multi-thread exec of trt, test=develop (#19338)	6 years ago
Tao Luo	f05d2c519d	paddle::framework::vectorize() templatization [PART3] (#19643) ... * paddle::framework::vectorize() templatization test=develop * update pybind/imperative.cc test=develop * revert update on unsqueeze_op.cc and warpctc_cudnn_op.cu.cc test=develop	6 years ago
Tao Luo	3ae939e48a	unify PADDLE_ASSERT_MSG into PADDLE_ENFORCE(error_message) (#19631) ... * remove assert.h * change PADDLE_ASSERT_MSG to PADDLE_ENFORCE test=develop * fix tensorrt paddle_enforce test=develop	6 years ago
Zhaolong Xing	76c95af000	Fix BUG: Mask RCNN inference diff When using AnalysisPredictor. (#19213) ... * fix mask rcnn bug: 1. affine channel fuse (diff) 2. condition block op (memory leak) 3. merge lod tensor op (diff) 4. memroy optim (diff) test=develop * fix ci aboud PADDLE_ENFOCE fix merge lod infer op ut test=develop	6 years ago
wopeizl	80b7ef6fc8	add tensorrt support for windows (#19084) ... * add tensorrt support for windows	6 years ago
Zhaolong Xing	3816d221ff	Fix the CE error which caused by paddle-trt version (#18941) ... * Fix Mask rcnn predictor 1. refine memory optim algorithm to support the model with the block op. 2. output diff : modify the affine channel fuse 3. add condition_block_infer op add interface for setting trt calib table dir test=develop * add the missing files. test=develop * 1 add trt fp16 support test=develop * fix trt fp16 ce error test=develop * add an vlog if the user use trt4 and specify fp16. test=develop	6 years ago
Zhaolong Xing	61238d31f7	Trt fp16 support (#18860) ... * Fix Mask rcnn predictor 1. refine memory optim algorithm to support the model with the block op. 2. output diff : modify the affine channel fuse 3. add condition_block_infer op add interface for setting trt calib table dir test=develop * add the missing files. test=develop * 1 add trt fp16 support test=develop	6 years ago
Huihuang Zheng	cfce4994cf	Merge cuda 9/10 dockerfile with root dockerfile (#18693) ... Also fix a dependency error which may cause compile error	6 years ago
Zhaolong Xing	26ae6d49e4	Update trt5 for paddle-trt (#18645) ... * update paddle-trt for: 1. fix bug: when batch > 2, core in split plugin. 2. add leaky_relu trt5.0 support (yolov3 from 65ms to 42ms.) 3. add new attr to dropout. 4. shuffle channel, swish, relu6 support test=develop * 1. fix ci test=develop	6 years ago
Zhaolong Xing	ae576f3c68	fix: when use the load model from memory mode, the RAM occupy is high (#17788) ... test=develop	6 years ago
Zhaolong Xing	61221ebc28	TRT: Support set dynamic range in int8 mode. (#17524) ... * fluid int8 train and trt int8 predict align. trt int8 predict init op converter * 2. align fluid int8 train and trt int8 inference. enhance quant dequant fuse pass enhance op converter, trt engine, trt engine op, trt subgraph pass. * 3. add delete_quant_dequant_pass for trt test=develop * 4. add the missing file test=develop * 5. i modify the c++ interface, but forget to modify the pybind code fix the IS_TRT_VERSION_GE bug, and fix elementwise op converter test=develop	6 years ago