25 Commits (e1a5fc449d6acccfd186309d54aa61fa216aa0da)

Author	SHA1	Message	Date
Shang Zhizhou	ea851796e5	TensorRT中ernie模型推理性能优化，支持变长输入 (#28367) ... * fp16 result ok * change -DWITH_NVINFER_PLUGIN toconfig.EnableTensorRtOSS * auto detect special slice op converter for ernie with trt oss * ernie oss only support fp16 * fix special_slice_plugin serialize bug * matmul in tensorrt ok * ernie unittest ok * add matmul tensorrt unittest * remove demo code	5 years ago
zlsh80826	ad6e3dd69c	[Paddle-TRT] Stack op plugin (#25605) ... * add stack_op to CMakeLists * add dim=3 support for scale op * add trt stack op, test=develop * remove debug message * add stack plugin serialize * remove slice, scale op, will add later * enhence error message * revise trt ernie test to conver the stack op CI testi, test=develop * add stack op serialization * fix test shape after adding stack op * remove slice op, will add after implementing serialization * roll back to min_graph=5 to avoid using slice op * fix scale op output layer * implement stack op createPlugin * use workspace and move the defination to .cu * move stack plugin creator definition to .cu, test=develop	5 years ago
Zhaolong Xing	133f1fc123	[Eernie TRT]: add slice op and add emb eltwise layernorm fp16 support (#23723) ... * refine ernie trt dynamic shape support 1. add slice op converter 2. add emb eltwise layernorm fp16 support test=develop * fix dynamic shape test ut test=develop * fix comments. test=develop * fix comments test=develop	6 years ago
Pei Yang	c528f1d4f3	[Paddle-TRT] Add hard_sigmoid and hard_swish support(support MobilenetV3) (#23672) ... * add hard_sigmoid trt op converter * add hard_swish op converter and plugin. test=develop * add macro to adapt lower trt version. test=develop	6 years ago
Pei Yang	3d5d217030	Revert "[Paddle-TRT] Add hard_sigmoid and hard_swish support(support MobilenetV3) (#23536)", test=develop (#23642) ... This reverts commit cdc6d4e292.	6 years ago
Pei Yang	cdc6d4e292	[Paddle-TRT] Add hard_sigmoid and hard_swish support(support MobilenetV3) (#23536) ... * add hard_sigmoid trt op converter * add hard_swish op converter and plugin. test=develop	6 years ago
Zhaolong Xing	430b0099c9	[Paddle-TRT]: Ernie Dynamic shape support. (#23138) ... * add dynamic plugin support. test=develop * change emb eltwise layernorm to math function test=develop * add emb eltwise layernorm test=develop * can run dynamic shape ernie test=develop * fix ci test=develop * add ut for trt ernie dynamic test=develop * refine dynamic shape c++ interface. test=develop * fix comments test=develop * fix comments test=develop	6 years ago
Pei Yang	50bee83f71	add TRT support for instance_norm op (#21928) ... * add TRT support for instance_norm op	6 years ago
Pei Yang	0a51098a71	Add TRT support for BERT (#21135) ... * add gelu plugin * align trt bert with gpu * add support for fused fc with relu, * add unittest for bert trt	6 years ago
Pei Yang	e89c16b90d	Bug Fix: Paddle-TRT cannot handle adaptive pooling in pool2d op converter and "num" attribute in split op converter (#20733) ... * fix pool2d trt converter, test=develop * add fix for split op converter, test=develop	6 years ago
Zhaolong Xing	26ae6d49e4	Update trt5 for paddle-trt (#18645) ... * update paddle-trt for: 1. fix bug: when batch > 2, core in split plugin. 2. add leaky_relu trt5.0 support (yolov3 from 65ms to 42ms.) 3. add new attr to dropout. 4. shuffle channel, swish, relu6 support test=develop * 1. fix ci test=develop	6 years ago
nhzlx	1d5ef7c9ee	5. add static trt load model ... 1). add static trt load model 2). fix bug: when device_id is not 0, the trt will have a bug test=develop	7 years ago
nhzlx	f75815b78c	add prelu gpu inference	7 years ago
nhzlx	e62872df8b	fix conflicts	7 years ago
Houjiang Chen	33c65517fd	Update CMakeLists.txt test=develop	7 years ago
Houjiang Chen	01bda73116	Update CMakeLists.txt	7 years ago
hjchen2	2c2a192eb1	Resolve merge conflicts ... test=develop	7 years ago
Yiqun Liu	8bc1c5d2ab	Implement the Tensorrt plugin for elementwise op (#14487) ... * Initialize the elementwise plugin. * Implement the basic CUDA kernel of elementwise plugin. test=develop	7 years ago
hjchen2	a8c077df7c	Implement leaky relu tensorRT converter	7 years ago
hjchen2	2825685f2a	Fix tensorrt plugin cmake dependency, test=develop	7 years ago
nhzlx	83f8c403a7	Merge branch 'develop' of https://github.com/paddlepaddle/paddle into fix_avg_pool_trt_bug ... test=develop	7 years ago
nhzlx	b969116988	fxi avg pool trt bug and fix cpplint	7 years ago
hjchen2	21f33b4274	Complete PRelu plugin and Conv2d transpose op converter	7 years ago
nhzlx	d38fd6a0fc	add plugin support and offer an simple split sample	7 years ago
nhzlx	2d7134bc37	add initial code for plugin	7 years ago