1359 Commits (aba759ba16422abf8cd39ae7e19d24f5997b9ade)

Author	SHA1	Message	Date
Wilber	39546aa2f3	Add pass compatible and unit test. (#27377)	5 years ago
Pei Yang	a5ef246cac	Optimize emb_eltwise_layernorm_plugin and support fp16 (#27128)	5 years ago
Zhou Wei	ebc6d54446	fix cache file judge (#27369)	5 years ago
Zhou Wei	f992f8d7ef	fix judge cache file of inference api more accurate (#27175) ... fix judge cache file of inference api more accurate	5 years ago
Wilber	dae62556cb	Enhance infer error info message (#26731)	5 years ago
Shang Zhizhou	47fdc60ecc	Optimize slice trt plugin (#26970) ... * optimize slice TRT plugin This patch removes unnecessary barrier for data transfer of needed offset, so data transfer can be overlap with GPU kernel execution. This patch also fixes incorrect name of slice plugin. That is, replaces "layernorm" with "slice" test=develop * add serialize/deserialize to slice plugin * add static shape slice trt plugin * fix slice trt op convertor dynamic shape bug * fix format by clang-format * fix pylint format error * fix problems commented by peiyang Co-authored-by: Ryan Jeng <rjeng@nvidia.com>	5 years ago
石晓伟	bd77a4258d	error messages of inference/tests, test=develop (#27259)	5 years ago
Shang Zhizhou	e6e2e53782	Optimize error report (#27254) ... * optimize errror report * add test case for pad op converter * fix some spelling mistake commented by peiyang	5 years ago
Pei Yang	3ae3b86489	fix trt_dynamic_shape_ernie_deserialize_test (#27290) ... * fix trt_dynamic_shape_ernie_deserialize_test * support when opt cache dir does not exist	5 years ago
joanna.wozna.intel	1483ea2304	Add bfloat16 passes (#26999)	5 years ago
Pei Yang	aae41c6fca	refine error message related to paddle-TRT (#27256)	5 years ago
石晓伟	255e0cf978	error messages of inference/capi, test=develop (#27258)	5 years ago
lidanqing	5c4eed66fd	Fix GRU mkldnn kernel fail on look_table_v2 (#27198) ... * Fix the lookup_table_v2 failed on GRU mkldnn kernel issue test=develop * fix according to reviews, removed x_num_col_dims test=develop * update gru model. change according to reviews test=develop * change according to reviews test=develop	5 years ago
Wilber	f1ab288201	enhance inference error info. (#27251)	5 years ago
Wilber	1b84c0bf43	Lite subgraph refine predictor (#27167)	5 years ago
Qi Li	78446ecdba	[UT] fix run type of ut test cases of test_train_recognize_digits and test_api_impl, test=develop (#27218)	5 years ago
Wilber	edd962b1d0	Add 2.0 inference api doc. (#27125)	5 years ago
LoveAn	cbcd5e407a	Fix problem that target name already exists when there isn't model data cache, test=develop (#27142)	5 years ago
Wilber	632125415c	Refine python inference api (#26958)	5 years ago
YUNSHEN XIE	b150f2b3a6	disable test_trt_dynamic_shape_ernie_ser_deser,test=document_fix (#27059)	5 years ago
LoveAn	fab8bbf25b	Modify data download function and support unittests of inference APIs on windows (#26988) ... * Modify data download function, and support unittests of inference APIs on windows, test=develop * The import error compatible with py2 and py3, and fix unittests problems of inference APIs on Windows, test=develop	5 years ago
joanna.wozna.intel	95e1434bb2	Add bfloat16 data type (#25402)	5 years ago
YUNSHEN XIE	d8984a6b90	limit timeout value setting on linux (#26923)	5 years ago
Zhou Wei	1771d9f880	fix cache judge more safe (#26910)	5 years ago
joanna.wozna.intel	0627a319b0	Restore "Add mkldnn bfloat16 option to C-API " (#26882) ... * Add mkldnn bfloat16 option to C-API * Add test for bfloat16 gpu * Change coverage test * Repair capi_gpu test	5 years ago
Zhaolong Xing	932bbe955b	fix pool trt plugin bug (#26463) ... test=develop	5 years ago
zlsh80826	ad6e3dd69c	[Paddle-TRT] Stack op plugin (#25605) ... * add stack_op to CMakeLists * add dim=3 support for scale op * add trt stack op, test=develop * remove debug message * add stack plugin serialize * remove slice, scale op, will add later * enhence error message * revise trt ernie test to conver the stack op CI testi, test=develop * add stack op serialization * fix test shape after adding stack op * remove slice op, will add after implementing serialization * roll back to min_graph=5 to avoid using slice op * fix scale op output layer * implement stack op createPlugin * use workspace and move the defination to .cu * move stack plugin creator definition to .cu, test=develop	5 years ago
石晓伟	ced6e87eee	Revert "Add mkldnn bfloat16 option to C-API (#26676)" (#26854) ... This reverts commit 02083bda40.	5 years ago
Pei Yang	78a530c219	[Paddle-TRT] TRT dynamic shape support PaddleSlim quant models (#26536) ... * support trt dynamic shape int8 * add unittest * add support for sigmoid; adapt to trt6+ api	5 years ago
zlsh80826	ac63c7cdef	fix a skip_layernorm bug, test=develop (#26800)	5 years ago
Adam	8bcb1f29d9	Add conv+affine_channel fuse pass to MKLDNN pass strategy and fix it (#26779)	5 years ago
Wilber	68e0560c2f	refine paddle inference api (#26774) ... * refine paddle inference api Co-authored-by: nhzlx <nhzlx.dragon@gmail.com>	5 years ago
Pei Yang	e3f8e5cf5c	trt int8 support conv2d_transpose (#26636)	5 years ago
joanna.wozna.intel	02083bda40	Add mkldnn bfloat16 option to C-API (#26676) ... * Add mkldnn bfloat16 option to C-API * Add test for bfloat16 gpu * Change coverage test	5 years ago
chalsliu	dc56c89822	Add the option to execute unit tests only at night (#26669) ... * Add the option to execute unit tests only at night * set ut nightly label for 3 cases.	5 years ago
LoveAn	02fc1fef8b	Fix the cmake-function named inference_download_and_uncompress on Windows (#26512) ... * Fix the cmake-function named inference_download_and_uncompress with Windows, test=develop * Fix some problems when remove limit of unittests on Windows, test=develop * Using URL to download file instead of DOWNLOAD_COMMAND. test=develop	5 years ago
YUNSHEN XIE	a8b5741fb4	add a few unittests for setting timeout properity (#26630)	5 years ago
Pei Yang	379222c3f1	add output scale and trt op teller support for hard_swish and hard_sigmoid (#26499)	5 years ago
Zhaolong Xing	b7a86e92a8	fix dy shape bug in trt7.1 (#26273) ... test=develop	5 years ago
Pei Yang	b757466b0d	fix trt dynamic ernie serialization unit test (#26228)	5 years ago
Wilber	c84aa9c61f	update diff val. (#26242)	5 years ago
Wilber	fb72b192e7	[DOC] Fix dead link (#26154)	5 years ago
lidanqing	65b97d6215	GRU model xnli dataset C++ tester (#25534) ... * Add laxical GRU unit test performance works * Get model accuracy * model and data name to be confirmed test=develop * update model name and output format test=develop * update according to reviews test=develop * add accuracy check * accuracy check between native and analysis test=develop * fix a reading bug, fix gru passes sequence test=develop * fix passes sequence test=develop	5 years ago
joanna.wozna.intel	734cf1c3e9	Change use_quantizer attribute name and data type (#25838) ... * Change use_quantizer attribute name and data type * Fix problem with setting attribute * Add changes due to review * Small change in function * Restore use_quantizer attr for compatibility	5 years ago
Pei Yang	beb0ca5fab	Fix TRT plugin registry without TRT lib (#25982) ... * fix trt plugin registry without trt lib * support trt4 * refine code style	5 years ago
Pei Yang	b717895f64	Fix registering trt plugin (#25744) ... * develop dynamic shape serilization * add test param for gelu * fix bugs * delete redundant comments * debug * fix conflict. test=develop * fix bug. test=develop * add trt dynamic shape serialized support * fix ernie serialized bug test=develop * fix codestyle test=develop * fix bug test=develop * fix bug.test=develop * modify cmakelist test=develop * fix bug test=develop * fix error message. test=develop * fix trt register plugin based on pr#25003 * add trt dynload * fix deserialization bug of not finding plugin registration * refine code style * recover engine key in tensorrt_subgraph_pass * for ci coverage * add unittest for deserialization Co-authored-by: haozech <chenhaoze94@gmail.com>	5 years ago
Pei Yang	9e9a569dae	add trt int8 support for elementwise_mul and scale (#25676)	5 years ago
Zhaolong Xing	bcddefef39	[Fix Ut]: fix inference ut which exist bug on windows. (#25814) ... * fix windows test test=develop * fix ci test=develop	5 years ago
Pei Yang	eef98b7f86	add macro check for using TRT api dynamicRangeIsSet() (#25694)	5 years ago
Pei Yang	f82baed866	fix trt instance norm plugin on gcc8. test=develop (#25730)	5 years ago