362 Commits (d84eb9b33f8751e50c73c07ed0d88379d9a406e9)

Author	SHA1	Message	Date
Wojciech Uss	f399bed8d9	Add an option to set number of warmup iterations (#27739)	4 years ago
Wilber	2bc70ab2e2	Fix lite_resnet50 unit test. (#27611)	4 years ago
Shang Zhizhou	77a36f8997	[buf fix]:fix some unittests error (#27540) ... * [buf fix]:fix unittest test_activation_op error * split long-time unittests to smaller ones * rename some unittests	4 years ago
YUNSHEN XIE	66951ab2ea	modified timeout value for 4 ut (#27462)	4 years ago
Pei Yang	a5ef246cac	Optimize emb_eltwise_layernorm_plugin and support fp16 (#27128)	4 years ago
Zhou Wei	ebc6d54446	fix cache file judge (#27369)	4 years ago
Zhou Wei	f992f8d7ef	fix judge cache file of inference api more accurate (#27175) ... fix judge cache file of inference api more accurate	4 years ago
石晓伟	bd77a4258d	error messages of inference/tests, test=develop (#27259)	5 years ago
Pei Yang	3ae3b86489	fix trt_dynamic_shape_ernie_deserialize_test (#27290) ... * fix trt_dynamic_shape_ernie_deserialize_test * support when opt cache dir does not exist	5 years ago
lidanqing	5c4eed66fd	Fix GRU mkldnn kernel fail on look_table_v2 (#27198) ... * Fix the lookup_table_v2 failed on GRU mkldnn kernel issue test=develop * fix according to reviews, removed x_num_col_dims test=develop * update gru model. change according to reviews test=develop * change according to reviews test=develop	5 years ago
Wilber	1b84c0bf43	Lite subgraph refine predictor (#27167)	5 years ago
LoveAn	cbcd5e407a	Fix problem that target name already exists when there isn't model data cache, test=develop (#27142)	5 years ago
YUNSHEN XIE	b150f2b3a6	disable test_trt_dynamic_shape_ernie_ser_deser,test=document_fix (#27059)	5 years ago
LoveAn	fab8bbf25b	Modify data download function and support unittests of inference APIs on windows (#26988) ... * Modify data download function, and support unittests of inference APIs on windows, test=develop * The import error compatible with py2 and py3, and fix unittests problems of inference APIs on Windows, test=develop	5 years ago
YUNSHEN XIE	d8984a6b90	limit timeout value setting on linux (#26923)	5 years ago
Zhou Wei	1771d9f880	fix cache judge more safe (#26910)	5 years ago
joanna.wozna.intel	0627a319b0	Restore "Add mkldnn bfloat16 option to C-API " (#26882) ... * Add mkldnn bfloat16 option to C-API * Add test for bfloat16 gpu * Change coverage test * Repair capi_gpu test	5 years ago
zlsh80826	ad6e3dd69c	[Paddle-TRT] Stack op plugin (#25605) ... * add stack_op to CMakeLists * add dim=3 support for scale op * add trt stack op, test=develop * remove debug message * add stack plugin serialize * remove slice, scale op, will add later * enhence error message * revise trt ernie test to conver the stack op CI testi, test=develop * add stack op serialization * fix test shape after adding stack op * remove slice op, will add after implementing serialization * roll back to min_graph=5 to avoid using slice op * fix scale op output layer * implement stack op createPlugin * use workspace and move the defination to .cu * move stack plugin creator definition to .cu, test=develop	5 years ago
石晓伟	ced6e87eee	Revert "Add mkldnn bfloat16 option to C-API (#26676)" (#26854) ... This reverts commit 02083bda40.	5 years ago
Pei Yang	78a530c219	[Paddle-TRT] TRT dynamic shape support PaddleSlim quant models (#26536) ... * support trt dynamic shape int8 * add unittest * add support for sigmoid; adapt to trt6+ api	5 years ago
Wilber	68e0560c2f	refine paddle inference api (#26774) ... * refine paddle inference api Co-authored-by: nhzlx <nhzlx.dragon@gmail.com>	5 years ago
joanna.wozna.intel	02083bda40	Add mkldnn bfloat16 option to C-API (#26676) ... * Add mkldnn bfloat16 option to C-API * Add test for bfloat16 gpu * Change coverage test	5 years ago
chalsliu	dc56c89822	Add the option to execute unit tests only at night (#26669) ... * Add the option to execute unit tests only at night * set ut nightly label for 3 cases.	5 years ago
YUNSHEN XIE	a8b5741fb4	add a few unittests for setting timeout properity (#26630)	5 years ago
Pei Yang	b757466b0d	fix trt dynamic ernie serialization unit test (#26228)	5 years ago
Wilber	c84aa9c61f	update diff val. (#26242)	5 years ago
Wilber	fb72b192e7	[DOC] Fix dead link (#26154)	5 years ago
lidanqing	65b97d6215	GRU model xnli dataset C++ tester (#25534) ... * Add laxical GRU unit test performance works * Get model accuracy * model and data name to be confirmed test=develop * update model name and output format test=develop * update according to reviews test=develop * add accuracy check * accuracy check between native and analysis test=develop * fix a reading bug, fix gru passes sequence test=develop * fix passes sequence test=develop	5 years ago
Pei Yang	b717895f64	Fix registering trt plugin (#25744) ... * develop dynamic shape serilization * add test param for gelu * fix bugs * delete redundant comments * debug * fix conflict. test=develop * fix bug. test=develop * add trt dynamic shape serialized support * fix ernie serialized bug test=develop * fix codestyle test=develop * fix bug test=develop * fix bug.test=develop * modify cmakelist test=develop * fix bug test=develop * fix error message. test=develop * fix trt register plugin based on pr#25003 * add trt dynload * fix deserialization bug of not finding plugin registration * refine code style * recover engine key in tensorrt_subgraph_pass * for ci coverage * add unittest for deserialization Co-authored-by: haozech <chenhaoze94@gmail.com>	5 years ago
Zhaolong Xing	bcddefef39	[Fix Ut]: fix inference ut which exist bug on windows. (#25814) ... * fix windows test test=develop * fix ci test=develop	5 years ago
Pei Yang	f82baed866	fix trt instance norm plugin on gcc8. test=develop (#25730)	5 years ago
Adam	98899b73d2	Fix FC + GRU fuse pass (#25687)	5 years ago
Pei Yang	43f9f180e5	Add api to clear intermediate tensors in AnalysisPredictor (#25069) ... * add api to clear intemediate tensors in analysis predictor. test=develop * add python api. test=develop	5 years ago
Wilber	4474fc1033	fix compile on windows. test=develop (#25310)	5 years ago
Wojciech Uss	23a4f54b73	rename qat into quant (#24948) ... test=develop	5 years ago
Wojciech Uss	56fa3880e3	rename qat into quant in filenames only (#25194) ... test=develop	5 years ago
Pei Yang	b2f5a149e7	[Paddle-TRT] Better Paddle-TensorRT support for PaddleSlim quant models (#25097) ... * Paddle-TensorRT support slim QAT. test=develop * add comments. test=develop * use RenameInput instead of ResetInputs. test=develop	5 years ago
iducn	f282599229	disable unitest for gcc8(#25134)	5 years ago
Wilber	f8e370ac7f	[Inference] [unittest] Inference unit tests rely on dynamic libraries (#24743)	5 years ago
silingtong123	126d3d693b	support C++ inference shared library on windows (#24672) ... * add SetCommandLineOption * add the print_FLAGS function * remove the test demo * modify the location of macro * add the 'WITH_STATIC_LIB' option on windows * modify the macro of PD_INFER_DECL * modify the the fuction name * modify the unittest * modify the code style	5 years ago
Zhaolong Xing	f68d4fb3f1	fix bert bug using trt6 when compile with CUDA_ARCH_NAME=All (#24517) ... test=develop	5 years ago
Tao Luo	c1df7048c7	add UT for mkldnn_cache_capacity (#24336) ... * add UT for mkldnn_cache_capacity test=develop * fix comparison of integer expressions of different signedness test=develop	5 years ago
石晓伟	17ac6e2580	update the analysis predictor for multi-stream support, test=develop (#24046) ... * update the analysis predictor, test=develop * update the unit test, test=develop * no priority set before the inferface determined, test=develop * interface name generalization, test=develop	5 years ago
lidanqing	61ec30f030	Update QAT INT8 2.0 doc (#24127) ... * update local data preprocess doc * update for 2.0 QAT test=develop test=document_fix * update benchmark data test=develop test=document_fix Co-authored-by: Wojciech Uss <wojciech.uss@intel.com>	5 years ago
Pei Yang	695a53c874	remove conv_bn_fuse_pass and fc_fuse_pass in trt int8 calibration. test=develop (#23805)	5 years ago
Zhaolong Xing	133f1fc123	[Eernie TRT]: add slice op and add emb eltwise layernorm fp16 support (#23723) ... * refine ernie trt dynamic shape support 1. add slice op converter 2. add emb eltwise layernorm fp16 support test=develop * fix dynamic shape test ut test=develop * fix comments. test=develop * fix comments test=develop	5 years ago
lidanqing	2291634c5c	Add user local data preprocess support (#23692) ... * add local data preprocess support for imagenet test=develop * add local data2bin tests test=develop * locally two tests passed test=develop * change according to reviews test=develop	5 years ago
Zhaolong Xing	3acb047a20	[Paddle-TRT]: add eltwise,pool2d, prelu, scale, concat, gelu dynamic shape support (#23396) ... * add elementwise pool2d, prelu, shuffle channel test=develop * add scale and refine concat eltwise conveter test=develop * refine elementwise converter test=develop * refine ut test and enforce error. test=develop * modify const cast test=develop	5 years ago
mozga-intel	3baaee9aab	Remove: NGraph engine from PDPD repository (#23545) ... * Remove the NGraph engine from PDPD repository 1. Each operator was removed from the operator's directory 2. Each test was removed from the unittest directory 3. The parallel executor support was removed from the PDPD 4. The CMake file was removed from the PDPD 5. The NG flags were removed from the repository test=develop * Remove ngraph from: 1. Cmake file 2. Python file test=develop	5 years ago
Zhaolong Xing	1a6ce8b910	add swish split gelu plugin dynamic support (#23305) ... test=develop	5 years ago