60 Commits (d84eb9b33f8751e50c73c07ed0d88379d9a406e9)

Author	SHA1	Message	Date
Pei Yang	ae6e40a7fd	Add unittests and OP version registry for tensorrt_subgraph_pass (#27544) ... * add unittests and op version register for tensorrt_subgraph_pass * rename to test_trt_subgraph_pass.py * fix softmax converter diff when padding dim=1	4 years ago
wanghuancoder	df43905f12	use iwyu clean include (#27267) ... * use iwyu clean include, test=develop, test=win * compilation error, test=develop * fix compilation error2, test=develop * fix compilation error3, test=develop * fix compilation error4, test=develop * fix compilation error5, test=develop * fix compilation error6, test=develop * fix compilation error7, test=develop * fix compilation error8, test=develop * fix compilation error8, test=develop * fix compilation error10, test=develop * fix compilation error11, test=develop	4 years ago
Chen Weihang	765064476b	Polish some lost invalid error message (#27445) ... * polish some lost error msg * add some math file to white list * polish detail based reviewer commnet	4 years ago
Pei Yang	fda54c0212	errmsg refine of trt plugin (#27309)	4 years ago
Pei Yang	a5ef246cac	Optimize emb_eltwise_layernorm_plugin and support fp16 (#27128)	4 years ago
Shang Zhizhou	47fdc60ecc	Optimize slice trt plugin (#26970) ... * optimize slice TRT plugin This patch removes unnecessary barrier for data transfer of needed offset, so data transfer can be overlap with GPU kernel execution. This patch also fixes incorrect name of slice plugin. That is, replaces "layernorm" with "slice" test=develop * add serialize/deserialize to slice plugin * add static shape slice trt plugin * fix slice trt op convertor dynamic shape bug * fix format by clang-format * fix pylint format error * fix problems commented by peiyang Co-authored-by: Ryan Jeng <rjeng@nvidia.com>	4 years ago
Pei Yang	aae41c6fca	refine error message related to paddle-TRT (#27256)	4 years ago
Zhaolong Xing	932bbe955b	fix pool trt plugin bug (#26463) ... test=develop	5 years ago
zlsh80826	ad6e3dd69c	[Paddle-TRT] Stack op plugin (#25605) ... * add stack_op to CMakeLists * add dim=3 support for scale op * add trt stack op, test=develop * remove debug message * add stack plugin serialize * remove slice, scale op, will add later * enhence error message * revise trt ernie test to conver the stack op CI testi, test=develop * add stack op serialization * fix test shape after adding stack op * remove slice op, will add after implementing serialization * roll back to min_graph=5 to avoid using slice op * fix scale op output layer * implement stack op createPlugin * use workspace and move the defination to .cu * move stack plugin creator definition to .cu, test=develop	5 years ago
zlsh80826	ac63c7cdef	fix a skip_layernorm bug, test=develop (#26800)	5 years ago
Zhaolong Xing	b7a86e92a8	fix dy shape bug in trt7.1 (#26273) ... test=develop	5 years ago
Pei Yang	beb0ca5fab	Fix TRT plugin registry without TRT lib (#25982) ... * fix trt plugin registry without trt lib * support trt4 * refine code style	5 years ago
Pei Yang	b717895f64	Fix registering trt plugin (#25744) ... * develop dynamic shape serilization * add test param for gelu * fix bugs * delete redundant comments * debug * fix conflict. test=develop * fix bug. test=develop * add trt dynamic shape serialized support * fix ernie serialized bug test=develop * fix codestyle test=develop * fix bug test=develop * fix bug.test=develop * modify cmakelist test=develop * fix bug test=develop * fix error message. test=develop * fix trt register plugin based on pr#25003 * add trt dynload * fix deserialization bug of not finding plugin registration * refine code style * recover engine key in tensorrt_subgraph_pass * for ci coverage * add unittest for deserialization Co-authored-by: haozech <chenhaoze94@gmail.com>	5 years ago
Pei Yang	f82baed866	fix trt instance norm plugin on gcc8. test=develop (#25730)	5 years ago
Jeng Bai-Cheng	fc93266b0a	Improve qkv transpose performance (#23919) ... Use vector instruction (LDG.128) to improve qkv transpose. It provides 1.4X speedup at same GPU base frequency. test=develop	5 years ago
Zhaolong Xing	7b7e605189	[Fix BUGs]: fix multhead matmul pass's instable bug (#25123) ... * fix multhead matmul's instable test=develop * fix multihead matmul bug test=develop * fix converage problem test=develop	5 years ago
Zhaolong Xing	843581154f	fix emb eltwise layernorm (#24873) ... test=develop	5 years ago
Leo Chen	fa657b3dbb	fix bug of prelu when rank not equal 4, test=develop (#25067) ... * fix bug of prelu when rank not equal 4, test=develop * fix prelu inference, test=develop * fix api, test=develop * fix shape when mode is chennel, test=develop * remove debug code, test=develop * add unittest, test=develop	5 years ago
zlsh80826	49e4ee27e1	[Paddle-TRT] slice kernel optimization (#24783) ... * parallel move shared data test=develop * test=develop	5 years ago
zlsh80826	fdbe114b12	[Paddle-TRT] use float constant instead of double test=develop (#24544)	5 years ago
Zhaolong Xing	35148d17f7	[BUG]: Head number can only be > 1 on multihead op (#23974) ... * support the head number == 1 test=develop * fix slice op error. test=develop	5 years ago
Zhou Wei	7817003795	Optimize the error messages of paddle CUDA API (#23816) ... * Optimize the error messages of paddle CUDA API, test=develop * fix the error messages of paddle CUDA API, test=develop * Refactoring PADDLE_ENFORCE_CUDA_SUCCESS, and apply to curand/cudnn/cublas/NCCL,test=develop * remove build_ex_string,test=develop * merge conflict,test=develop	5 years ago
Zhaolong Xing	133f1fc123	[Eernie TRT]: add slice op and add emb eltwise layernorm fp16 support (#23723) ... * refine ernie trt dynamic shape support 1. add slice op converter 2. add emb eltwise layernorm fp16 support test=develop * fix dynamic shape test ut test=develop * fix comments. test=develop * fix comments test=develop	5 years ago
Pei Yang	c528f1d4f3	[Paddle-TRT] Add hard_sigmoid and hard_swish support(support MobilenetV3) (#23672) ... * add hard_sigmoid trt op converter * add hard_swish op converter and plugin. test=develop * add macro to adapt lower trt version. test=develop	5 years ago
Pei Yang	015acdbfb1	Refine error message of leaky_relu, tensorrt_engine, split, prelu op converter (#23661)	5 years ago
Zhaolong Xing	3acb047a20	[Paddle-TRT]: add eltwise,pool2d, prelu, scale, concat, gelu dynamic shape support (#23396) ... * add elementwise pool2d, prelu, shuffle channel test=develop * add scale and refine concat eltwise conveter test=develop * refine elementwise converter test=develop * refine ut test and enforce error. test=develop * modify const cast test=develop	5 years ago
Pei Yang	3d5d217030	Revert "[Paddle-TRT] Add hard_sigmoid and hard_swish support(support MobilenetV3) (#23536)", test=develop (#23642) ... This reverts commit cdc6d4e292.	5 years ago
Pei Yang	cdc6d4e292	[Paddle-TRT] Add hard_sigmoid and hard_swish support(support MobilenetV3) (#23536) ... * add hard_sigmoid trt op converter * add hard_swish op converter and plugin. test=develop	5 years ago
Zhaolong Xing	1a6ce8b910	add swish split gelu plugin dynamic support (#23305) ... test=develop	5 years ago
Zhaolong Xing	430b0099c9	[Paddle-TRT]: Ernie Dynamic shape support. (#23138) ... * add dynamic plugin support. test=develop * change emb eltwise layernorm to math function test=develop * add emb eltwise layernorm test=develop * can run dynamic shape ernie test=develop * fix ci test=develop * add ut for trt ernie dynamic test=develop * refine dynamic shape c++ interface. test=develop * fix comments test=develop * fix comments test=develop	5 years ago
Pei Yang	d8a9b134e3	fix trt instance_norm serialize bug. test=develop (#22152)	5 years ago
Pei Yang	50bee83f71	add TRT support for instance_norm op (#21928) ... * add TRT support for instance_norm op	5 years ago
Pei Yang	0a51098a71	Add TRT support for BERT (#21135) ... * add gelu plugin * align trt bert with gpu * add support for fused fc with relu, * add unittest for bert trt	5 years ago
Pei Yang	e89c16b90d	Bug Fix: Paddle-TRT cannot handle adaptive pooling in pool2d op converter and "num" attribute in split op converter (#20733) ... * fix pool2d trt converter, test=develop * add fix for split op converter, test=develop	5 years ago
Tao Luo	3ae939e48a	unify PADDLE_ASSERT_MSG into PADDLE_ENFORCE(error_message) (#19631) ... * remove assert.h * change PADDLE_ASSERT_MSG to PADDLE_ENFORCE test=develop * fix tensorrt paddle_enforce test=develop	6 years ago
wopeizl	80b7ef6fc8	add tensorrt support for windows (#19084) ... * add tensorrt support for windows	6 years ago
Zhaolong Xing	26ae6d49e4	Update trt5 for paddle-trt (#18645) ... * update paddle-trt for: 1. fix bug: when batch > 2, core in split plugin. 2. add leaky_relu trt5.0 support (yolov3 from 65ms to 42ms.) 3. add new attr to dropout. 4. shuffle channel, swish, relu6 support test=develop * 1. fix ci test=develop	6 years ago
nhzlx	06a088a199	fix comments and fix cpplint ... test=develop	6 years ago
nhzlx	0ed63b2108	6. delete useless predictor id ... test=develop	6 years ago
nhzlx	1d5ef7c9ee	5. add static trt load model ... 1). add static trt load model 2). fix bug: when device_id is not 0, the trt will have a bug test=develop	6 years ago
nhzlx	f75815b78c	add prelu gpu inference	6 years ago
hjchen2	6eba5bd276	Fix direct copy and refine split ut ... test=develop	6 years ago
hjchen2	5857fb3014	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into develop ... test=develop	6 years ago
hjchen2	3e3599f3d9	Refine split tensorrt plugin	6 years ago
nhzlx	e62872df8b	fix conflicts	6 years ago
Houjiang Chen	33c65517fd	Update CMakeLists.txt test=develop	6 years ago
Houjiang Chen	01bda73116	Update CMakeLists.txt	6 years ago
hjchen2	2c2a192eb1	Resolve merge conflicts ... test=develop	6 years ago
Yiqun Liu	8bc1c5d2ab	Implement the Tensorrt plugin for elementwise op (#14487) ... * Initialize the elementwise plugin. * Implement the basic CUDA kernel of elementwise plugin. test=develop	6 years ago
hjchen2	a8c077df7c	Implement leaky relu tensorRT converter	6 years ago