Paddle

Commit Graph

Author	SHA1	Message	Date
Shang Zhizhou	8084b7594b	fix batchnorm when inpu dims < 3 (#31933 ) * fix batchnorm when inpu dims < 3 * add unittest for batchnorm dims = 2	5 years ago
zlsh80826	64ee255ffd	[Paddle-TRT] yolobox (#31755 ) * yolobox converter and plugin * yolobox unittest * add dynamic shape restriction * fix git merge log	5 years ago
zlsh80826	e3a38d790a	[Paddle-TRT] roi_align_plugin (#31732 ) * add roi_align_plugin * add roi align unit_test * add roi align serialization * remove roi align static plugin because of batch dim issue * refine roi align unittest and add fp16/serialization * add trt roi align condition to op_teller * refine error message * remove unnecessary reshape layer	5 years ago
zlsh80826	bfb5cf5567	[Paddle-TRT] trt affine channel converter (#31628 ) * trt affine channel converter * add trt affine channel base test * add trt affine channel NHWC * remove asterisk for python2 compatibility * trt affine channel converter * add trt affine channel base test * add trt affine channel NHWC * remove asterisk for python2 compatibility * fix rebase * move LodTensor to Tensor * add dbg info * affine channel converter only support NCHW * scale,bias are parameters, use create_parameters api * reduce test input size to not exceed the timelimit of ci * refine affine channel unittest and add serialization/dynamic test * change super to InferencePassTest for python2 compatibility * change super to InferencePassTest for python2 compatibility * fix affine channel fp16 serialize setting	5 years ago
zlsh80826	01aa252624	[Paddle-TRT] multiclass nms (#31742 ) * add multiclass_nms * add multiclass_nms unittest * add default enable_tensorrt_oss option * refine multiclas nms unittest and add serialization/dynamic test * change super to InferencePassTest for python2 compatibility * refine multiclass nms unittest * move out dynamic shape test due to ci timelimit	5 years ago
Wilber	f4d9212de2	trt plugin upgrade to pluginv2ext (#31670 )	5 years ago
Shang Zhizhou	9d04ef7369	fix tensorrt output varible reshape (#31733 ) * fix tensorrt output varible reshape * move padding shape x 1 x 1 in ernie to qkv and fc * update layer name * fix softmax when input is dynamic, fc not padding any more * fix varlen * move fc x_dim assert to op_teller	5 years ago
zlsh80826	bfced39eb6	[Paddle-TRT] nearest_interp op (#31626 ) * nearest_interp op converter w/ dynamic/static * fix data_layout include * add trt nearest unit_test * add nearest_interp NHWC test * update trt nearest interp nhwc testcase * remove asterisk for python2 compatibility * add empty line to prevent conflict * nearest_interp op converter w/ dynamic/static * fix data_layout include * add trt nearest unit_test * add nearest_interp NHWC test * update trt nearest interp nhwc testcase * remove asterisk for python2 compatibility * add empty line to prevent conflict * change the priority of out_h, out_w	5 years ago
zlsh80826	fe241fd02f	[Paddle-TRT] gather converter (#31640 ) * trt gather converter * add trt gather unit_test	5 years ago
zlsh80826	4ea3427865	[Paddle-TRT] support batch axis concatenation when using dynamic shape (#31627 ) * support batch axis concatenation when using dynamic shape * opteller can't return true early, or some test will not be executed	5 years ago
Shang Zhizhou	50ac7dbfd0	Trt elementwise plugin serialize (#31587 ) * add serialize unittest * fix element_op trt plugin serialize bug	5 years ago
Shang Zhizhou	f57739be35	fix ernie_varlen when cutting head (#31497 )	5 years ago
Pei Yang	32211fe9c4	TRT conv2d converter support SAME padding (#31379 )	5 years ago
Shang Zhizhou	77c44e2f1b	change prelu plugin to tensorRT layer (#30210 )	5 years ago
Pei Yang	2e9e3fad15	add n-d input support for trt scale converter (#31316 ) * add n-d input support for trt scale converter * add flatten for ut * fix dims	5 years ago
Qi Li	72d99c5dcd	[ROCM] update fluid operators for rocm (part4), test=develop (#31225 )	5 years ago
Pei Yang	00b09e86ac	[Paddle-TRT] support group_norm (#31040 ) * add group norm plugin * fix compile problems * move concat axis check to trt op teller * add nbDims for scale and bias nv dims * add group norm unit test * fix unittest * add trt version restriction for group norm op teller * fix unittest	5 years ago
Shang Zhizhou	a5c56d83a1	update trt int8 calibrator to IEntropyCalibratorV2 (#31060 ) * update trt int8 calibrator to IEntropyCalibratorV2 * add delele opt_cache for trt_split_converter_test	5 years ago
Wilber	01ccfbcde9	update trt error message when input height or width is -1 (#31019 )	5 years ago
Pei Yang	9b54fe4154	add trt transpose and flatten converter (#31022 )	5 years ago
Shang Zhizhou	e6095bc2ce	fix split trt plugin initialize (#30875 ) * fix split trt plugin initialize * update	5 years ago
wanghuancoder	35c5b23f68	use iwyu clean include second time, test=develop (#30829 ) * use iwyu clean include second time, test=develop	5 years ago
Shang Zhizhou	b909450994	fix trt plugin clone and initialize bugs in TRT7.1+ (#30709 ) * fix trt plugin clone and initialize bugs * fix unit test error * enable trt in ci py3 * update unittest timeout	5 years ago
Shang Zhizhou	ae0f88a988	add DLA support：C++&&Python api (#30165 ) * add dla * add dla done * add python api Co-authored-by: shangzhizhou <root@szth-rp-fanyi-opera49.szth.baidu.com>	5 years ago
Leo Chen	81217a94d8	unify calling cudaSetDevice (#30470 ) * unify calling cudaSetDevice * fix compile	5 years ago
alncat	7bbf3ac5ab	Added support for inference using quantization aware trained dygraph (#30288 ) * added support for inference using qunatization aware trained dygraph * added support for inference using qunatization aware trained dygraph correct boost get usage * Delete incorrect warning message (#30196) * fix warning and no grad * clean redundant API alias in 2.0 - part 2 (#30013) * delete paddle.nn.functional.assign * fix dynamic to static error * just add the op error message for the matmul xpu (#30246) add the op error message for the matmul xpu * Add Static Variable Clone (#30208) Add clone method for static Variable so that this interface will be same as dygraph. It fixed some bugs in dy2stat * use wget to replace curl to download the lcov file (#30229) * use wget to replace curl to download the lcov file * add cache for lcov * fix test_pool3d_op timeout issue (#30248) * Fix unittests bugs. (#30250) * modify error message based on comments (#30189) * modify error message based on comments * edit code according to review. * Correct spelling according to review. * Fix bug for 'save mutiple method' (#30218) * Fix bug for 'save mutiple method' * To pass coverage. * edit code to pass coverage. * edit code to pass coverage. * add unittest for coverage. * change for coverage. * edit for coverage. * added support for inference using qunatization aware trained dygraph * Alias from paddle.fluid.layers.auc to paddle.static.auc (#30206) * add alias from fluid.layers.auc to static.auc * Update __init__.py * added support for inference using qunatization aware trained dygraph correct boost get usage * corrected boost get usage * corrected naming issues and enforcing zero check * correct paddle enforce message * added more error checkings * corrected error report message and optimized code * corrected findvar usage * corrected paddle_enforce in scope * correct error messages * correct error reporting format Co-authored-by: LielinJiang <50691816+LielinJiang@users.noreply.github.com> Co-authored-by: XiaoguangHu <46782768+XiaoguangHu01@users.noreply.github.com> Co-authored-by: wawltor <fangzeyang0904@hotmail.com> Co-authored-by: Huihuang Zheng <zhhsplendid@gmail.com> Co-authored-by: YUNSHEN XIE <1084314248@qq.com> Co-authored-by: Bai Yifan <me@ethanbai.com> Co-authored-by: gongweibao <weibao.gong@gmail.com> Co-authored-by: WeiXin <weixin10@baidu.com> Co-authored-by: Jiaqi Liu <liujiaqi06@baidu.com>	6 years ago
WeiXin	66dc4ac77b	modify error message based on comments (#30189 ) * modify error message based on comments * edit code according to review. * Correct spelling according to review.	6 years ago
Wilber	01a287bf0a	fix windows compile when WITH_PYTHON=ON and WITH_TENSORRT=ON (#30194 )	6 years ago
Pei Yang	2480bdef6c	change hard_swish from plugin to layer (#29177 ) * change hard_swish from plugin to layer * add ut when threshold != scale	6 years ago
Pei Yang	f860de4af7	support clip op trt converter (#29411 )	6 years ago
Shang Zhizhou	b9e76a0103	detect tensorRT plugin fp16 in runtime (#27933 ) * remove -DSUPPORTS_CUDA_FP16 in cuda.cmake * comile with cuda9 * add some unittest * notest;test=coverage * add unittest for trt plugin swish && split * update ernie unittest * fix some error message * remove repeated judgement of CUDA version in mbEltwiseLayerNormOpConverter * fix comile errror when CUDA_ARCH_NAME < Pascal" * fix comile error * update unittest timeout * compile with cuda9 * update error msg * fix code style * add some comments * add define IF_CUDA_ARCH_SUPPORT_FP16 * rename IF_CUDA_ARCH_SUPPORT_FP16 to CUDA_ARCH_FP16_SUPPORTED	6 years ago
Pei Yang	994673bf4f	change avg pooling and global pooling to trt layer in dynamic shape mode (#28702 ) * change avg pooling and global pooling to trt layer * add support for static shape global pooling * modify trt errmsg	6 years ago
Shang Zhizhou	8699f38d08	裁剪transformer模型trt支持；修复tensorRT不支持DeletePass的bug (#28517 ) * skip_layernorm_op done * add unittest * slice op convertor support trt < 6 * skip_layernorm only work in ernie	6 years ago
Shang Zhizhou	ea851796e5	TensorRT中ernie模型推理性能优化，支持变长输入 (#28367 ) * fp16 result ok * change -DWITH_NVINFER_PLUGIN toconfig.EnableTensorRtOSS * auto detect special slice op converter for ernie with trt oss * ernie oss only support fp16 * fix special_slice_plugin serialize bug * matmul in tensorrt ok * ernie unittest ok * add matmul tensorrt unittest * remove demo code	6 years ago
Pei Yang	602d2ce5c9	change avg pooling from trt plugin to trt layer (#28032 )	6 years ago
Shang Zhizhou	bbc837ee72	add info log for trt input dynamic shape check (#27796 ) * add info log for trt input dynamic shape check * fix error msg error	6 years ago
Pei Yang	ae6e40a7fd	Add unittests and OP version registry for tensorrt_subgraph_pass (#27544 ) * add unittests and op version register for tensorrt_subgraph_pass * rename to test_trt_subgraph_pass.py * fix softmax converter diff when padding dim=1	6 years ago
wanghuancoder	df43905f12	use iwyu clean include (#27267 ) * use iwyu clean include, test=develop, test=win * compilation error, test=develop * fix compilation error2, test=develop * fix compilation error3, test=develop * fix compilation error4, test=develop * fix compilation error5, test=develop * fix compilation error6, test=develop * fix compilation error7, test=develop * fix compilation error8, test=develop * fix compilation error8, test=develop * fix compilation error10, test=develop * fix compilation error11, test=develop	6 years ago
Chen Weihang	765064476b	Polish some lost invalid error message (#27445 ) * polish some lost error msg * add some math file to white list * polish detail based reviewer commnet	6 years ago
Pei Yang	fda54c0212	errmsg refine of trt plugin (#27309 )	6 years ago
Pei Yang	a5ef246cac	Optimize emb_eltwise_layernorm_plugin and support fp16 (#27128 )	6 years ago
Shang Zhizhou	47fdc60ecc	Optimize slice trt plugin (#26970 ) * optimize slice TRT plugin This patch removes unnecessary barrier for data transfer of needed offset, so data transfer can be overlap with GPU kernel execution. This patch also fixes incorrect name of slice plugin. That is, replaces "layernorm" with "slice" test=develop * add serialize/deserialize to slice plugin * add static shape slice trt plugin * fix slice trt op convertor dynamic shape bug * fix format by clang-format * fix pylint format error * fix problems commented by peiyang Co-authored-by: Ryan Jeng <rjeng@nvidia.com>	6 years ago
Shang Zhizhou	e6e2e53782	Optimize error report (#27254 ) * optimize errror report * add test case for pad op converter * fix some spelling mistake commented by peiyang	6 years ago
Pei Yang	aae41c6fca	refine error message related to paddle-TRT (#27256 )	6 years ago
Zhaolong Xing	932bbe955b	fix pool trt plugin bug (#26463 ) test=develop	6 years ago
zlsh80826	ad6e3dd69c	[Paddle-TRT] Stack op plugin (#25605 ) * add stack_op to CMakeLists * add dim=3 support for scale op * add trt stack op, test=develop * remove debug message * add stack plugin serialize * remove slice, scale op, will add later * enhence error message * revise trt ernie test to conver the stack op CI testi, test=develop * add stack op serialization * fix test shape after adding stack op * remove slice op, will add after implementing serialization * roll back to min_graph=5 to avoid using slice op * fix scale op output layer * implement stack op createPlugin * use workspace and move the defination to .cu * move stack plugin creator definition to .cu, test=develop	6 years ago
Pei Yang	78a530c219	[Paddle-TRT] TRT dynamic shape support PaddleSlim quant models (#26536 ) * support trt dynamic shape int8 * add unittest * add support for sigmoid; adapt to trt6+ api	6 years ago
zlsh80826	ac63c7cdef	fix a skip_layernorm bug, test=develop (#26800 )	6 years ago
Pei Yang	e3f8e5cf5c	trt int8 support conv2d_transpose (#26636 )	6 years ago
Pei Yang	379222c3f1	add output scale and trt op teller support for hard_swish and hard_sigmoid (#26499 )	6 years ago

1 2 3 4 5 ...

270 Commits (develop)