Commit Graph

49 Commits (e89b12884afa24a54a5a3d94754dd4cf461dc213)

Author SHA1 Message Date
Zhaolong Xing e89b12884a
FIx C++ inference BUG: When open memory optim and enable trt subgraph at the same time, there is a bug (#19969)
6 years ago
Zhaolong Xing 76c95af000
Fix BUG: Mask RCNN inference diff When using AnalysisPredictor. (#19213)
6 years ago
Tao Luo 076f833110
add config.SetMkldnnCacheCapacity api for mkldnn cache clear strategy (#18580)
6 years ago
Zhaolong Xing 88b52a27fe
Inference: fix mask rcnn model diff, optim memory usage, memory leak. (#18532)
6 years ago
Zhaolong Xing ae576f3c68
fix: when use the load model from memory mode, the RAM occupy is high (#17788)
6 years ago
Zhaolong Xing 61221ebc28
TRT: Support set dynamic range in int8 mode. (#17524)
6 years ago
石晓伟 a72dbe9abf
Cherry-pick benchmark related changes from release/1.4 (#17156)
6 years ago
Shixiaowei02 bddb2cd315 resolve conflicts with the develop branch test=develop
6 years ago
nhzlx 953bdde058 Merge branch 'develop' of https://github.com/paddlepaddle/paddle into HEAD
6 years ago
Wojciech Uss 46677fb080 Move cpu_quantize_* passes into mkldnn subfolder
6 years ago
nhzlx 3df7b98a0f Merge branch 'develop' of https://github.com/paddlepaddle/paddle into HEAD
6 years ago
Wojciech Uss cbe2dbf0db Add enabling quantization (#16326)
6 years ago
nhzlx a25331bc26 cherry-pick from feature/anakin-engine: deal the changing shape when using anakin #16189
6 years ago
nhzlx c79f06d3d8 cherry-pick from feature/anakin-engine: add batch interface for pd-anakin #16178
6 years ago
nhzlx 69d37f81d7 cherry-pick from feature/anakin-engine: refine anakin subgraph. #16157
6 years ago
Wojciech Uss 2579ade45f Add cpu_quantize_pass for C-API quantization (#16127)
6 years ago
nhzlx a9ed427749 cant not pass ci
6 years ago
nhzlx 0ed63b2108 6. delete useless predictor id
6 years ago
nhzlx 2070fb246d 4. do the trt_engine optim during init.
6 years ago
Yan Chunwei 655179089f
AnalysisConfig remove contrib namespace (#15540)
7 years ago
Zhaolong Xing 97b76c94c4
Merge pull request #15242 from NHZlX/trt_int8_ultimate_version
7 years ago
Yan Chunwei e2818c8608
add dynamic memory optim (#15457)
7 years ago
nhzlx 92cf4a4c6b fix comments
7 years ago
nhzlx 027d24c831 Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into trt_int8_ultimate_version
7 years ago
Yan Chunwei 885c4e57ab
fea/infer memory optim2 (#14953)
7 years ago
nhzlx 312fe0ece1 add trt int8 calibration support
7 years ago
nhzlx 4e3522e5b4 add trt int8 support
7 years ago
Yan Chunwei 6ccf8685f7
refactor tensorrt node teller (#15181)
7 years ago
nhzlx 71636e677d add min_subgraph_size attr to tensorrt config
7 years ago
bingyanghuang 943ad4781f One possible solution to add flexibility for mkldnn placement pass (#14768)
7 years ago
Tao Luo 743cb840f1 update with comments
7 years ago
Tao Luo 405b2486db support loading from memory
7 years ago
superjomn 4bf6817cbc fix gpu load model
7 years ago
Yan Chunwei 9f252e0032
Combine Inference Analysis with IR (#13914)
7 years ago
minqiyang 87450b9ad4 Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into fix_vlog
7 years ago
Zhaolong Xing ba8b5619a3
Revert "cherry picked windows patches."
7 years ago
minqiyang fcc0452c8b Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into fix_vlog
7 years ago
minqiyang 0c3227a523 Change the origin VLOG level to 10 times
7 years ago
dzhwinter dbe90cc0f6 merge develop branch
7 years ago
Jiabin Yang 6ba2b22279
Merge pull request #13096 from JiabinYang/fix_mac
7 years ago
Yan Chunwei af15f6f038
fea/refine fuse (#13076)
7 years ago
JiabinYang 7c7d3d6172 Fix mac
7 years ago
Yan Chunwei 902f19b46a
fea/fuse attention lstm simplify.with fusion lstm.with sequnce expand (#13006)
7 years ago
dzhwinter 488a2dd2e8 with ir node
7 years ago
gongweibao 819ac3df0a
Modify style (#12465)
7 years ago
Yan Chunwei dcfbc6a661
inference analyzer as bin (#12450)
7 years ago
Yan Chunwei 5082642bdb
feature/analysis to support sub-graph for TRT engine (#11538)
7 years ago
gongweibao 4dda54aa5a
Fix unlikely (#11537)
7 years ago
Yan Chunwei d734595978
Feature/pass manager (#11440)
7 years ago