Commit Graph

1404 Commits (e2d01eb650dba6267046c1cfd6e64cf8cfd74267)

Author SHA1 Message Date
Shang Zhizhou b9e76a0103
detect tensorRT plugin fp16 in runtime (#27933)
5 years ago
Shang Zhizhou 562ded1041
fix unittest trt_dynamic_shape_transformer_prune_test error (#29122)
5 years ago
Pei Yang 994673bf4f
change avg pooling and global pooling to trt layer in dynamic shape mode (#28702)
5 years ago
HappyAngel de528981e5
fix paddlepredictor build error. test=develop (#28792)
5 years ago
Wilber a22ea652cf
fix trt delete_pass bug. (#28763)
5 years ago
gongweibao 1dad8ceaab
Fix gpu memory allocation bug. (#28703)
5 years ago
Wilber 04cefeacc5
Disable windows gpu static lib. (#28741)
5 years ago
Wilber 8b97bb2e1f
Update cmake for arm ft and fix a bug for Predictor dtor. (#28586)
5 years ago
Leo Chen 90805e2df7
Register op_version for new attribute use_addto (#28463)
5 years ago
YUNSHEN XIE 7b1619e69b
disable test_trt_dynamic_shape_transformer_prune,test=document_fix (#28588)
5 years ago
Shang Zhizhou 8699f38d08
裁剪transformer模型trt支持;修复tensorRT不支持DeletePass的bug (#28517)
5 years ago
Wilber 1bf4836580
[Inference] Add TryShrinkMemory interface. (#28409)
5 years ago
Wilber 645e999afc
fix api_impl test. (#28483)
5 years ago
YUNSHEN XIE ba0756325a
exec ut no more than 15s 1 (#28439)
5 years ago
joanna.wozna.intel 7821759d48
Add bfloat16 softmax and gelu (#28394)
5 years ago
iducn ba0fe0a812
revert the modified shell script (#28453)
5 years ago
Shang Zhizhou ea851796e5
TensorRT中ernie模型推理性能优化,支持变长输入 (#28367)
5 years ago
lidanqing 8cd1c102d9
Enable GRU infer model running CAPI (#28313)
5 years ago
iducn f763cb81a6
Modify the shell script according to the specification (#28302)
5 years ago
石晓伟 842a4e5abd
fix analyzer_capi_tester, test=develop (#28289)
5 years ago
Adam Osewski 7db747d9e8
oneDNN BatchNorm + Act fusion pass. (#27912)
5 years ago
Wilber f935ca8a50
[lite-xpu-subgraph] Fix xpu compile and test xpu ci. (#27932)
5 years ago
Pei Yang 602d2ce5c9
change avg pooling from trt plugin to trt layer (#28032)
5 years ago
joanna.wozna.intel a21b57109c
Add AVX512 instruction check for C-API (#28087)
5 years ago
joanna.wozna.intel 840c521b77
Fix problem with flags fp32 and int8 (#27954)
5 years ago
joanna.wozna.intel ddcd1b5381
Add bfloat16 resnet50 test (#27755)
5 years ago
Wilber 345574a6ed
Demo CMakeLists add openmp flag. (#27848)
5 years ago
Shang Zhizhou bbc837ee72
add info log for trt input dynamic shape check (#27796)
5 years ago
Wilber 9005c5a260
Lite subgraph support arm cpu. (#27827)
5 years ago
chen zhiyu 6335e6a0a6
add musl option (#27798)
5 years ago
石晓伟 0d27591642
save operator version infomation to program desc, test=develop (#27668)
5 years ago
Wojciech Uss f399bed8d9
Add an option to set number of warmup iterations (#27739)
5 years ago
Wilber 2bc70ab2e2
Fix lite_resnet50 unit test. (#27611)
5 years ago
Pei Yang ae6e40a7fd
Add unittests and OP version registry for tensorrt_subgraph_pass (#27544)
5 years ago
Shang Zhizhou 77a36f8997
[buf fix]:fix some unittests error (#27540)
5 years ago
Wilber df7fabeedc
Fix memory leak for mkldnn. (#27493)
5 years ago
Wilber ec4155d7d0
windows lib size crop from 5.4G to 3.9G (#27477)
5 years ago
wanghuancoder df43905f12
use iwyu clean include (#27267)
5 years ago
YUNSHEN XIE 66951ab2ea
modified timeout value for 4 ut (#27462)
5 years ago
Zhou Wei 292b24aa6d
fix bug MD of compile, And add MD/STATIC/OPENBLAS inference lib check on windows (#27051)
5 years ago
Wilber 5034d181f3
update for 2.0 inference api. (#27473)
5 years ago
Chen Weihang 765064476b
Polish some lost invalid error message (#27445)
5 years ago
Pei Yang fda54c0212
errmsg refine of trt plugin (#27309)
5 years ago
石晓伟 dd4c2d86a5
enhance error messages, test=develop (#27423)
5 years ago
Wilber afe94903c3
Rename fluid_inference to paddle_inference. (#27422)
5 years ago
Wilber 39546aa2f3
Add pass compatible and unit test. (#27377)
5 years ago
Pei Yang a5ef246cac
Optimize emb_eltwise_layernorm_plugin and support fp16 (#27128)
5 years ago
Zhou Wei ebc6d54446
fix cache file judge (#27369)
5 years ago
Zhou Wei f992f8d7ef
fix judge cache file of inference api more accurate (#27175)
5 years ago
Wilber dae62556cb
Enhance infer error info message (#26731)
5 years ago