Paddle

Commit Graph

Author	SHA1	Message	Date
joanna.wozna.intel	95e1434bb2	Add bfloat16 data type (#25402 )	5 years ago
YUNSHEN XIE	d8984a6b90	limit timeout value setting on linux (#26923 )	5 years ago
Zhou Wei	1771d9f880	fix cache judge more safe (#26910 )	5 years ago
joanna.wozna.intel	0627a319b0	Restore "Add mkldnn bfloat16 option to C-API " (#26882 ) * Add mkldnn bfloat16 option to C-API * Add test for bfloat16 gpu * Change coverage test * Repair capi_gpu test	5 years ago
Zhaolong Xing	932bbe955b	fix pool trt plugin bug (#26463 ) test=develop	5 years ago
zlsh80826	ad6e3dd69c	[Paddle-TRT] Stack op plugin (#25605 ) * add stack_op to CMakeLists * add dim=3 support for scale op * add trt stack op, test=develop * remove debug message * add stack plugin serialize * remove slice, scale op, will add later * enhence error message * revise trt ernie test to conver the stack op CI testi, test=develop * add stack op serialization * fix test shape after adding stack op * remove slice op, will add after implementing serialization * roll back to min_graph=5 to avoid using slice op * fix scale op output layer * implement stack op createPlugin * use workspace and move the defination to .cu * move stack plugin creator definition to .cu, test=develop	5 years ago
石晓伟	ced6e87eee	Revert "Add mkldnn bfloat16 option to C-API (#26676 )" (#26854 ) This reverts commit `02083bda40`.	5 years ago
Pei Yang	78a530c219	[Paddle-TRT] TRT dynamic shape support PaddleSlim quant models (#26536 ) * support trt dynamic shape int8 * add unittest * add support for sigmoid; adapt to trt6+ api	5 years ago
zlsh80826	ac63c7cdef	fix a skip_layernorm bug, test=develop (#26800 )	5 years ago
Adam	8bcb1f29d9	Add conv+affine_channel fuse pass to MKLDNN pass strategy and fix it (#26779 )	5 years ago
Wilber	68e0560c2f	refine paddle inference api (#26774 ) * refine paddle inference api Co-authored-by: nhzlx <nhzlx.dragon@gmail.com>	5 years ago
Pei Yang	e3f8e5cf5c	trt int8 support conv2d_transpose (#26636 )	5 years ago
joanna.wozna.intel	02083bda40	Add mkldnn bfloat16 option to C-API (#26676 ) * Add mkldnn bfloat16 option to C-API * Add test for bfloat16 gpu * Change coverage test	5 years ago
chalsliu	dc56c89822	Add the option to execute unit tests only at night (#26669 ) * Add the option to execute unit tests only at night * set ut nightly label for 3 cases.	5 years ago
LoveAn	02fc1fef8b	Fix the cmake-function named inference_download_and_uncompress on Windows (#26512 ) * Fix the cmake-function named inference_download_and_uncompress with Windows, test=develop * Fix some problems when remove limit of unittests on Windows, test=develop * Using URL to download file instead of DOWNLOAD_COMMAND. test=develop	5 years ago
YUNSHEN XIE	a8b5741fb4	add a few unittests for setting timeout properity (#26630 )	5 years ago
Pei Yang	379222c3f1	add output scale and trt op teller support for hard_swish and hard_sigmoid (#26499 )	5 years ago
Zhaolong Xing	b7a86e92a8	fix dy shape bug in trt7.1 (#26273 ) test=develop	5 years ago
Pei Yang	b757466b0d	fix trt dynamic ernie serialization unit test (#26228 )	5 years ago
Wilber	c84aa9c61f	update diff val. (#26242 )	5 years ago
Wilber	fb72b192e7	[DOC] Fix dead link (#26154 )	5 years ago
lidanqing	65b97d6215	GRU model xnli dataset C++ tester (#25534 ) * Add laxical GRU unit test performance works * Get model accuracy * model and data name to be confirmed test=develop * update model name and output format test=develop * update according to reviews test=develop * add accuracy check * accuracy check between native and analysis test=develop * fix a reading bug, fix gru passes sequence test=develop * fix passes sequence test=develop	5 years ago
joanna.wozna.intel	734cf1c3e9	Change use_quantizer attribute name and data type (#25838 ) * Change use_quantizer attribute name and data type * Fix problem with setting attribute * Add changes due to review * Small change in function * Restore use_quantizer attr for compatibility	5 years ago
Pei Yang	beb0ca5fab	Fix TRT plugin registry without TRT lib (#25982 ) * fix trt plugin registry without trt lib * support trt4 * refine code style	5 years ago
Pei Yang	b717895f64	Fix registering trt plugin (#25744 ) * develop dynamic shape serilization * add test param for gelu * fix bugs * delete redundant comments * debug * fix conflict. test=develop * fix bug. test=develop * add trt dynamic shape serialized support * fix ernie serialized bug test=develop * fix codestyle test=develop * fix bug test=develop * fix bug.test=develop * modify cmakelist test=develop * fix bug test=develop * fix error message. test=develop * fix trt register plugin based on pr#25003 * add trt dynload * fix deserialization bug of not finding plugin registration * refine code style * recover engine key in tensorrt_subgraph_pass * for ci coverage * add unittest for deserialization Co-authored-by: haozech <chenhaoze94@gmail.com>	5 years ago
Pei Yang	9e9a569dae	add trt int8 support for elementwise_mul and scale (#25676 )	5 years ago
Zhaolong Xing	bcddefef39	[Fix Ut]: fix inference ut which exist bug on windows. (#25814 ) * fix windows test test=develop * fix ci test=develop	5 years ago
Pei Yang	eef98b7f86	add macro check for using TRT api dynamicRangeIsSet() (#25694 )	5 years ago
Pei Yang	f82baed866	fix trt instance norm plugin on gcc8. test=develop (#25730 )	5 years ago
Adam	98899b73d2	Fix FC + GRU fuse pass (#25687 )	5 years ago
石晓伟	7206417259	supports xpu runtime, test=develop (#25554 ) * update ResetHolder, test=develop * add TensorShare for lite engine, test=develop * tensor data changed from copying to sharing, test=develop * supports xpu runtime, test=develop * fix code styles, test=develop	5 years ago
Zhaolong Xing	9df18b08f3	Disable windows static library generation (#25593 ) * fix windows ci test=develop * fix ci error	5 years ago
Wilber	848aca7ae8	[CI] [Lite-Subgraph] CI add lite subgraph check. (#25346 )	5 years ago
Pei Yang	43f9f180e5	Add api to clear intermediate tensors in AnalysisPredictor (#25069 ) * add api to clear intemediate tensors in analysis predictor. test=develop * add python api. test=develop	5 years ago
Jeng Bai-Cheng	fc93266b0a	Improve qkv transpose performance (#23919 ) Use vector instruction (LDG.128) to improve qkv transpose. It provides 1.4X speedup at same GPU base frequency. test=develop	5 years ago
Chen Weihang	7be285a66f	remove useless property, test=develop (#25461 ) remove useless property	5 years ago
Zhaolong Xing	7b7e605189	[Fix BUGs]: fix multhead matmul pass's instable bug (#25123 ) * fix multhead matmul's instable test=develop * fix multihead matmul bug test=develop * fix converage problem test=develop	5 years ago
MRXLT	3b8f0a64c2	Encryption infer (#25119 ) * add encrypt api for inference lib	5 years ago
Wilber	4474fc1033	fix compile on windows. test=develop (#25310 )	5 years ago
Wilber	0371cf6f94	fix compile for lite subgraph. test=develop (#25285 )	5 years ago
Wojciech Uss	23a4f54b73	rename qat into quant (#24948 ) test=develop	5 years ago
Sylwester Fraczek	36abeff44f	adding elementwiseadd quantization (#25178 )	5 years ago
Wojciech Uss	56fa3880e3	rename qat into quant in filenames only (#25194 ) test=develop	5 years ago
Wilber	f78e161ea3	remove paddle_use_kernel and paddle_use_op. test=develop (#25189 )	5 years ago
Pei Yang	b2f5a149e7	[Paddle-TRT] Better Paddle-TensorRT support for PaddleSlim quant models (#25097 ) * Paddle-TensorRT support slim QAT. test=develop * add comments. test=develop * use RenameInput instead of ResetInputs. test=develop	5 years ago
Shibo Tao	19c4db1b56	don't re-generate header file if content doesn't change (#25130 ) * don't re-generate header file if content doesn't change. test=develop * add copy_if_different function. test=develop	5 years ago
iducn	f282599229	disable unitest for gcc8(#25134 )	5 years ago
Zhaolong Xing	843581154f	fix emb eltwise layernorm (#24873 ) test=develop	5 years ago
石晓伟	9ab3cf039c	remove useless test_dot, test=develop (#24957 )	5 years ago
石晓伟	6783441e70	fix repeat definitions in liengine.cc, test=develop (#25020 )	5 years ago
Leo Chen	fa657b3dbb	fix bug of prelu when rank not equal 4, test=develop (#25067 ) * fix bug of prelu when rank not equal 4, test=develop * fix prelu inference, test=develop * fix api, test=develop * fix shape when mode is chennel, test=develop * remove debug code, test=develop * add unittest, test=develop	5 years ago
Jeng Bai-Cheng	bef4afa6de	bugfix for unique_ptr of IOptimizationProfile (#23917 ) This commit fixs the compiling bug regarding unique_ptr of IOptimizationProfile. IOptimizationProfile has protected dtor and is controlled by TensorRT internally. Application shouldn't delete the pointer of IOptimizationProfile. See TensorRT document: https://docs.nvidia.com/deeplearning/sdk/tensorrt-api/c_api/classnvinfer1_1_1_i_builder.html#a9ac47e100454151d8206ac91d543299a test=develop	5 years ago
zlsh80826	49e4ee27e1	[Paddle-TRT] slice kernel optimization (#24783 ) * parallel move shared data test=develop * test=develop	5 years ago
silingtong123	37bdb5269f	test=develop, add log message in the function UpdateDllFlag (#24937 ) * test=develop, add log message in the function UpdateDllFlag * test=develop, add the test	5 years ago
silingtong123	640196c446	test=develop, remove the tensorrt dll file from windows package (#24922 )	5 years ago
Zhou Wei	4058e736ff	temporarily disable these unittests failed on windows (#24942 )	5 years ago
silingtong123	ef9b36873d	test=develop, remove the gflags/gflags.h form paddle_api.h (#24921 )	5 years ago
silingtong123	fc4435174b	test=develop, fix the bug of tensorrt package can't compile on windows (#24860 ) * test=develop, fix a bug * test=develop, remove the macro of PADDLE_DLL_INFERENCE	5 years ago
石晓伟	76cdbb84b0	ignore warnings of external libraries, test=develop (#24193 )	5 years ago
Chen Weihang	d1062d5278	Replace all errors thrown by LOG(FATAL) with PADDLE_THROW (#24759 ) * remove REPLACE_ENFORCE_GLOG compile option & add ci rule prohibit LOG(FATAL) using, test=develop * remove ci test case, test=develop * replace all LOG(FATAL) & polish message, test=develop * fix typo, test=develop * polish error info detail, test=develop	5 years ago
Wilber	1e190a9e02	[Inference] [unittest] Inference unit tests rely on dynamic libraries (2) (#24859 )	5 years ago
Wilber	f8e370ac7f	[Inference] [unittest] Inference unit tests rely on dynamic libraries (#24743 )	5 years ago
silingtong123	126d3d693b	support C++ inference shared library on windows (#24672 ) * add SetCommandLineOption * add the print_FLAGS function * remove the test demo * modify the location of macro * add the 'WITH_STATIC_LIB' option on windows * modify the macro of PD_INFER_DECL * modify the the fuction name * modify the unittest * modify the code style	5 years ago
Pei Yang	181b1f5a30	adjust minimum trt version for hard_sigmoid converter to 5130. test=develop (#24746 )	5 years ago
zlsh80826	fdbe114b12	[Paddle-TRT] use float constant instead of double test=develop (#24544 )	5 years ago
Zhaolong Xing	f68d4fb3f1	fix bert bug using trt6 when compile with CUDA_ARCH_NAME=All (#24517 ) test=develop	5 years ago
pawelpiotrowicz	db2b6b6568	Hide globals & redesign restore PR (#24279 ) test=develop	5 years ago
Jacek Czaja	8b88cd5167	[oneDNN] Fix to inplace pass (#24442 ) * - Disabling inplace pass test=develop - Disable cycles test=develop - fix test=develop - Enhancement to in-place - Lint fixes test=develop * - Lint fixes test=develop	5 years ago
Jacek Czaja	d0307145a3	[oneDNN] disabling oneDNN inplace pass (#24406 )	5 years ago
Tao Luo	72c370c8d2	remove unused test_multi_thread_helper.h (#24399 ) test=develop	5 years ago
Tao Luo	63da846de0	remove old inference C++ tests (#24368 )	5 years ago
Chen Weihang	aa0f254fbe	Add macro BOOST_GET to enrich the error information of boost :: get (#24175 ) * add new macro BOOST_GET_SAFELY & unittests, test=develop * add different macro type, test=develop * fix get macro type in executor, test=develop * four macro part change backup * using one macro for all case, test=develop * revert attribute change, test=develop * change to three func to solve gcc4.8 bug, test=develop * polish some details, test=develop	5 years ago
Tao Luo	c1df7048c7	add UT for mkldnn_cache_capacity (#24336 ) * add UT for mkldnn_cache_capacity test=develop * fix comparison of integer expressions of different signedness test=develop	5 years ago
Tao Luo	9eedf05d2f	solve mklml memory leak on windows (#24015 ) * solve mklml memory leak on windows test=develop * remove unused msvcr120.dll test=develop	5 years ago
石晓伟	17ac6e2580	update the analysis predictor for multi-stream support, test=develop (#24046 ) * update the analysis predictor, test=develop * update the unit test, test=develop * no priority set before the inferface determined, test=develop * interface name generalization, test=develop	5 years ago
lidanqing	61ec30f030	Update QAT INT8 2.0 doc (#24127 ) * update local data preprocess doc * update for 2.0 QAT test=develop test=document_fix * update benchmark data test=develop test=document_fix Co-authored-by: Wojciech Uss <wojciech.uss@intel.com>	5 years ago
Sylwester Fraczek	e1a7a88057	added reshape transpose matmul fuse pass (#23754 )	5 years ago
arlesniak	d31a174f51	added fusing matmul-transpose-reshape pass (#23866 )	5 years ago
Pei Yang	695a53c874	remove conv_bn_fuse_pass and fc_fuse_pass in trt int8 calibration. test=develop (#23805 )	5 years ago
Zhaolong Xing	35148d17f7	[BUG]: Head number can only be > 1 on multihead op (#23974 ) * support the head number == 1 test=develop * fix slice op error. test=develop	5 years ago
Zhou Wei	7817003795	Optimize the error messages of paddle CUDA API (#23816 ) * Optimize the error messages of paddle CUDA API, test=develop * fix the error messages of paddle CUDA API, test=develop * Refactoring PADDLE_ENFORCE_CUDA_SUCCESS, and apply to curand/cudnn/cublas/NCCL,test=develop * remove build_ex_string,test=develop * merge conflict,test=develop	5 years ago
Zhaolong Xing	133f1fc123	[Eernie TRT]: add slice op and add emb eltwise layernorm fp16 support (#23723 ) * refine ernie trt dynamic shape support 1. add slice op converter 2. add emb eltwise layernorm fp16 support test=develop * fix dynamic shape test ut test=develop * fix comments. test=develop * fix comments test=develop	5 years ago
guofei	2b896c1f6b	Support LoDTensorArray in fetch (#23645 ) * Support LoDTEnsorArray in fetch op test=develop * Support LoDTensorArray in fetch test=develop * Support LoDTensorArray in fetch test=develop * Support LoDTensorArray in fetch test=develop * Support LoDTensorArray in fetch test=develop * Support LoDTensorArray in fetch test=develop * Support LoDTensorArray in fetch test=develop * Support LoDTensorArray in fetch test=develop * Support LoDTensorArray in fetch test=develop * Support LoDTensorArray in fetch test=develop	5 years ago
lidanqing	2291634c5c	Add user local data preprocess support (#23692 ) * add local data preprocess support for imagenet test=develop * add local data2bin tests test=develop * locally two tests passed test=develop * change according to reviews test=develop	5 years ago
chenhaoze	b7d185d6ca	OP clip, merge_lod_tensor, convert/elementwise error message enhancement (#23742 ) * OP clip, merge_lod_tensor, convert/elementwise error message enhancement. test=develop	5 years ago
Pei Yang	c528f1d4f3	[Paddle-TRT] Add hard_sigmoid and hard_swish support(support MobilenetV3) (#23672 ) * add hard_sigmoid trt op converter * add hard_swish op converter and plugin. test=develop * add macro to adapt lower trt version. test=develop	5 years ago
Pei Yang	015acdbfb1	Refine error message of leaky_relu, tensorrt_engine, split, prelu op converter (#23661 )	5 years ago
joanna.wozna.intel	12ba05ce0c	Add scale-matmul fuse pass (#23734 )	5 years ago
Zhaolong Xing	3acb047a20	[Paddle-TRT]: add eltwise,pool2d, prelu, scale, concat, gelu dynamic shape support (#23396 ) * add elementwise pool2d, prelu, shuffle channel test=develop * add scale and refine concat eltwise conveter test=develop * refine elementwise converter test=develop * refine ut test and enforce error. test=develop * modify const cast test=develop	5 years ago
chenhaoze	9b06dd8628	Add three passes and api reference of paddle_pass_builder. test=develop (#23741 ) * Add three passes and api reference of paddle_pass_builder.h	5 years ago
Zhaolong Xing	ed5766ffbc	refine act conv2d pool2d trt converter log (#23605 ) * refine act conv2d pool2d fc, trt converter log test=develop * fix comments test=develop	5 years ago
Pei Yang	28f04c6a5e	refine shuffle channel errmsg, test=develop (#23520 )	5 years ago
Tao Luo	e4f1b1c5e1	solve mklml memory leak (#23557 )	5 years ago
mozga-intel	3baaee9aab	Remove: NGraph engine from PDPD repository (#23545 ) * Remove the NGraph engine from PDPD repository 1. Each operator was removed from the operator's directory 2. Each test was removed from the unittest directory 3. The parallel executor support was removed from the PDPD 4. The CMake file was removed from the PDPD 5. The NG flags were removed from the repository test=develop * Remove ngraph from: 1. Cmake file 2. Python file test=develop	5 years ago
Pei Yang	3d5d217030	Revert "[Paddle-TRT] Add hard_sigmoid and hard_swish support(support MobilenetV3) (#23536 )", test=develop (#23642 ) This reverts commit `cdc6d4e292`.	5 years ago
Pei Yang	eb11633611	batch_norm trt converter error message, test=develop (#23620 )	5 years ago
joanna.wozna.intel	ce08fdcf2b	Add support for INT8 matmul in C-API quantization (#23463 ) * Integrate matmul with cpu_quantize_pass test=develop * Add matmul checking scales test=develop * Change condition of matmul quantization test=develop * Remove redundant var test=develop	5 years ago
Pei Yang	cdc6d4e292	[Paddle-TRT] Add hard_sigmoid and hard_swish support(support MobilenetV3) (#23536 ) * add hard_sigmoid trt op converter * add hard_swish op converter and plugin. test=develop	5 years ago
Pei Yang	42655ef721	Add full_like op. (#23364 ) * add full_like op. test=develop * add dygraph support. test=develop * increase coverage. test=develop	5 years ago
石晓伟	36b82eae0e	refine the doc of paddle_api.h, test=develop (#23402 ) * refine the doc of paddle_api.h, test=develop * fix documents, test=develop	5 years ago

1 2 3 4 5 ...

1388 Commits (c41fd033e5b4efd93a1ff738f7ee029a65075b50)