496 Commits (6df1ca54c869efe34723be8bee2ce15db7320a2a)

Author	SHA1	Message	Date
石晓伟	99bd16eb4e	bug fix of xpu lite engine, test=develop (#30918) ... * bug fix of xpu lite engine, test=develop * xpu zero copy tensor, test=develop * revert paddle/fluid/inference/tests/api/CMakeLists.txt	4 years ago
石晓伟	2ac4143b6c	support xpu with analysis predictor, test=develop (#30832) ... * support xpu inference with analysis predictor, test=develop * merge the cmake of the xpu toolchain, test=develop * add c-apis, test=develop * fix a bug in extern_xpu, test=develop	4 years ago
Wilber	b08ae368bb	ci compilation depends on a stable release (#30755) ... * update lite tag * disable ut	4 years ago
lidanqing	46989e889b	Fix python3 incompatibility issues (#30698) ... * solve python3 incompatibility issues * update checksum	4 years ago
Shang Zhizhou	ae0f88a988	add DLA support：C++&&Python api (#30165) ... * add dla * add dla done * add python api Co-authored-by: shangzhizhou <root@szth-rp-fanyi-opera49.szth.baidu.com>	4 years ago
Pei Yang	cf9bdb9404	extend trt ut timeout threshold (#30537)	4 years ago
Tao Luo	9dd71c74df	disable test_analyzer_detect (#30541)	4 years ago
石晓伟	efa54629fb	fix header file paths of gflags, commit 3, test=develop (#30273)	4 years ago
石晓伟	8c4500ff6d	fix header file paths of gflags, commit 2, test=develop (#30272)	4 years ago
weihaoji	b8207af6bc	[XPU] Remove lite_xpu ut lite_resnet50_test since fusion pass changes introduced precision diff. test=develop (#30122)	4 years ago
Shang Zhizhou	05b27695f1	add inference api： DisableTensorRtOps (#30109) ... * snap * add inference api: DisableTensorRtOPs * fix code style * update api to experimental * update variable name	4 years ago
cc	68398abce9	[Inference] zero_copy_tensor supports int8_t (#30053) ... * zero_copy_tensor supports int8_t	4 years ago
Pei Yang	6206b9bc71	fix ut:trt_resnext_test, trt_quant_int8_yolov3_r50_test, test_trt_dynamic_shape_ernie, test_trt_dynamic_shape_ernie_fp16_ser_deser, trt_cascade_rcnn_test (#29977)	4 years ago
jakpiase	edc06c6a1b	Added fc + activation fuse pass (currently only gelu, sigmoid and tanh are supported) (#29772)	4 years ago
Wilber	740c0d58c3	update for xpu ci. (#29568)	4 years ago
Jacek Czaja	83a693ee55	[oneDNN] Added Unit Test for Multiple instances prediction (#29501) ... * - Added infrastructre for new test - Added UT for Multiple models prediction - cosmetic fixes - lint - lint fixes * - Removed timeout for MMP test	4 years ago
Shang Zhizhou	225a9c4ed8	Fix unittest (#29412) ... * fix tensorrt unittest precision error * fix unittest precision error. test_trt_subgraph_pass && test_trt_dynamic_shape_transformer_prune	4 years ago
Shang Zhizhou	c59b4f28a2	fix cmake error when WITH_GPU=ON and WITH_TENSORRT=ON && WITH_MKL=OFF (#29275)	4 years ago
joanna.wozna.intel	5c61eeef61	Enable all image classification models (#29155)	4 years ago
Shang Zhizhou	b9e76a0103	detect tensorRT plugin fp16 in runtime (#27933) ... * remove -DSUPPORTS_CUDA_FP16 in cuda.cmake * comile with cuda9 * add some unittest * notest;test=coverage * add unittest for trt plugin swish && split * update ernie unittest * fix some error message * remove repeated judgement of CUDA version in mbEltwiseLayerNormOpConverter * fix comile errror when CUDA_ARCH_NAME < Pascal" * fix comile error * update unittest timeout * compile with cuda9 * update error msg * fix code style * add some comments * add define IF_CUDA_ARCH_SUPPORT_FP16 * rename IF_CUDA_ARCH_SUPPORT_FP16 to CUDA_ARCH_FP16_SUPPORTED	4 years ago
Shang Zhizhou	562ded1041	fix unittest trt_dynamic_shape_transformer_prune_test error (#29122)	4 years ago
YUNSHEN XIE	7b1619e69b	disable test_trt_dynamic_shape_transformer_prune,test=document_fix (#28588)	4 years ago
Shang Zhizhou	8699f38d08	裁剪transformer模型trt支持；修复tensorRT不支持DeletePass的bug (#28517) ... * skip_layernorm_op done * add unittest * slice op convertor support trt < 6 * skip_layernorm only work in ernie	4 years ago
Wilber	645e999afc	fix api_impl test. (#28483)	4 years ago
YUNSHEN XIE	ba0756325a	exec ut no more than 15s 1 (#28439) ... * disable ut test_parallel_executor_fetch_isolated_var,test=document_fix * test for limiting ut exec time as 15S * fix an error caused by cannot find ut * fix some error * can not find test_transformer * fix error caused by ut not run in windows * fix error caused by Compiler Options * fix error caused by setting timeout value as 15 in python/paddle/tests/CMakeLists.txt * setting timeout value to 120s for old ut * add the timeout value setting * fix error caused by ut only run in coverage_ci * add analyzer_transformer_profile_tester * fix some error * fix some error * fix error with inference option * fix error with inference option setting as ON_INFER * add some ut to set timeout * modified some option * fix error * fix some timeout error * fix error * fix error * fix timeout for test_analyzer_bfloat16_resnet50 * fix error * setting timeout properity for some ut * first pr for new ut timeout as 15S	4 years ago
Shang Zhizhou	ea851796e5	TensorRT中ernie模型推理性能优化，支持变长输入 (#28367) ... * fp16 result ok * change -DWITH_NVINFER_PLUGIN toconfig.EnableTensorRtOSS * auto detect special slice op converter for ernie with trt oss * ernie oss only support fp16 * fix special_slice_plugin serialize bug * matmul in tensorrt ok * ernie unittest ok * add matmul tensorrt unittest * remove demo code	4 years ago
lidanqing	8cd1c102d9	Enable GRU infer model running CAPI (#28313) ... * enable infer model running CAPI * output size should bigger than 0	4 years ago
石晓伟	842a4e5abd	fix analyzer_capi_tester, test=develop (#28289)	4 years ago
Wilber	f935ca8a50	[lite-xpu-subgraph] Fix xpu compile and test xpu ci. (#27932)	4 years ago
joanna.wozna.intel	840c521b77	Fix problem with flags fp32 and int8 (#27954)	4 years ago
joanna.wozna.intel	ddcd1b5381	Add bfloat16 resnet50 test (#27755)	4 years ago
Wojciech Uss	f399bed8d9	Add an option to set number of warmup iterations (#27739)	4 years ago
Wilber	2bc70ab2e2	Fix lite_resnet50 unit test. (#27611)	4 years ago
Shang Zhizhou	77a36f8997	[buf fix]:fix some unittests error (#27540) ... * [buf fix]:fix unittest test_activation_op error * split long-time unittests to smaller ones * rename some unittests	4 years ago
YUNSHEN XIE	66951ab2ea	modified timeout value for 4 ut (#27462)	4 years ago
Pei Yang	a5ef246cac	Optimize emb_eltwise_layernorm_plugin and support fp16 (#27128)	4 years ago
Zhou Wei	ebc6d54446	fix cache file judge (#27369)	4 years ago
Zhou Wei	f992f8d7ef	fix judge cache file of inference api more accurate (#27175) ... fix judge cache file of inference api more accurate	4 years ago
Wilber	dae62556cb	Enhance infer error info message (#26731)	4 years ago
石晓伟	bd77a4258d	error messages of inference/tests, test=develop (#27259)	4 years ago
Pei Yang	3ae3b86489	fix trt_dynamic_shape_ernie_deserialize_test (#27290) ... * fix trt_dynamic_shape_ernie_deserialize_test * support when opt cache dir does not exist	4 years ago
lidanqing	5c4eed66fd	Fix GRU mkldnn kernel fail on look_table_v2 (#27198) ... * Fix the lookup_table_v2 failed on GRU mkldnn kernel issue test=develop * fix according to reviews, removed x_num_col_dims test=develop * update gru model. change according to reviews test=develop * change according to reviews test=develop	4 years ago
Wilber	1b84c0bf43	Lite subgraph refine predictor (#27167)	4 years ago
LoveAn	cbcd5e407a	Fix problem that target name already exists when there isn't model data cache, test=develop (#27142)	5 years ago
YUNSHEN XIE	b150f2b3a6	disable test_trt_dynamic_shape_ernie_ser_deser,test=document_fix (#27059)	5 years ago
LoveAn	fab8bbf25b	Modify data download function and support unittests of inference APIs on windows (#26988) ... * Modify data download function, and support unittests of inference APIs on windows, test=develop * The import error compatible with py2 and py3, and fix unittests problems of inference APIs on Windows, test=develop	5 years ago
YUNSHEN XIE	d8984a6b90	limit timeout value setting on linux (#26923)	5 years ago
Zhou Wei	1771d9f880	fix cache judge more safe (#26910)	5 years ago
joanna.wozna.intel	0627a319b0	Restore "Add mkldnn bfloat16 option to C-API " (#26882) ... * Add mkldnn bfloat16 option to C-API * Add test for bfloat16 gpu * Change coverage test * Repair capi_gpu test	5 years ago
zlsh80826	ad6e3dd69c	[Paddle-TRT] Stack op plugin (#25605) ... * add stack_op to CMakeLists * add dim=3 support for scale op * add trt stack op, test=develop * remove debug message * add stack plugin serialize * remove slice, scale op, will add later * enhence error message * revise trt ernie test to conver the stack op CI testi, test=develop * add stack op serialization * fix test shape after adding stack op * remove slice op, will add after implementing serialization * roll back to min_graph=5 to avoid using slice op * fix scale op output layer * implement stack op createPlugin * use workspace and move the defination to .cu * move stack plugin creator definition to .cu, test=develop	5 years ago