Commit Graph

67 Commits (748c2d3ea2238ebac1e0604e0863f1a5a6799c32)

Author SHA1 Message Date
Yan Chunwei 526790e652
infer get program (#15511)
6 years ago
Zhaolong Xing 97b76c94c4
Merge pull request #15242 from NHZlX/trt_int8_ultimate_version
6 years ago
Yan Chunwei e2818c8608
add dynamic memory optim (#15457)
6 years ago
nhzlx 92cf4a4c6b fix comments
6 years ago
nhzlx 027d24c831 Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into trt_int8_ultimate_version
6 years ago
Yan Chunwei 885c4e57ab
fea/infer memory optim2 (#14953)
6 years ago
Yan Chunwei e84234b551
make clone thread safe (#15363)
6 years ago
nhzlx b95f2ff8fe fix win build bug
6 years ago
nhzlx 312fe0ece1 add trt int8 calibration support
6 years ago
nhzlx 4e3522e5b4 add trt int8 support
6 years ago
Yan Chunwei 875a07c32d
refactor inference analysis api (#14634)
6 years ago
tensor-tang 516fe301ee add comment in case of empty name
6 years ago
tensor-tang dca68cdf97 throw error when name not find
6 years ago
tensor-tang cd94df8679 fix load and refine
6 years ago
nhzlx 71636e677d add min_subgraph_size attr to tensorrt config
6 years ago
qingqing01 51a9fca323
Async memory copy (#15013)
6 years ago
Yu Yang 9bd70a1e04 Change tensor uses proto::VarType::type
6 years ago
bingyanghuang 943ad4781f One possible solution to add flexibility for mkldnn placement pass (#14768)
6 years ago
Tao Luo 743cb840f1 update with comments
6 years ago
Tao Luo 42359e88a4 clean code
6 years ago
Tao Luo 405b2486db support loading from memory
6 years ago
Yan Chunwei 4b7617740e
fix container not cleared (#14231)
6 years ago
minqiyang a02ce58f2c Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into revert_vlog
6 years ago
Yiqun Liu 726f2cefe3
Fix bug of referencing a temporary variable. (#14614)
6 years ago
minqiyang be04d99fe4 Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into revert_vlog
6 years ago
minqiyang 53433d7f2e Revert the changes of VLOG
6 years ago
peizhilin 36cd18b549 Merge remote-tracking branch 'upstream/develop' into windows/build
6 years ago
qingqing01 39ec80def4
Remove the memory copy of feeding data in C++ inference API (#14577)
6 years ago
peizhilin 1afa9492af Recover the profiler
6 years ago
Yiqun Liu bf222f197d
Use sub scope in tensor_array_to_tensor op. (#14524)
6 years ago
luotao1 116979a40a refine api name
6 years ago
luotao1 a5c4b463c9 add SetMKLDNNThreadId api
6 years ago
luotao1 e21edb26f6 add Set/GetCPUNumThreads api
6 years ago
nhzlx a4dc1d4292 Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into refine_trt
6 years ago
nhzlx faeb9b8aa9 fix compile rely problem
6 years ago
nhzlx b742d46520 fix demo ci bug on trt
6 years ago
hjchen2 a8c077df7c Implement leaky relu tensorRT converter
6 years ago
superjomn 4bf6817cbc fix gpu load model
6 years ago
hjchen2 21f33b4274 Complete PRelu plugin and Conv2d transpose op converter
6 years ago
nhzlx ddb120357c Merge branch 'develop' of https://github.com/paddlepaddle/paddle into add_trt_plugin
6 years ago
Yan Chunwei 9f252e0032
Combine Inference Analysis with IR (#13914)
6 years ago
minqiyang 0c3227a523 Change the origin VLOG level to 10 times
6 years ago
Yan Chunwei ee74be3a49
[1.1] Bugfix/tensorarray (#14044)
6 years ago
Wojciech Uss 5083ec3a1b do not enable MKL-DNN twice
6 years ago
Wojciech Uss c3b70aece9 Add MKL-DNN placement pass (#13958)
6 years ago
Yan Chunwei 6809238d97
fix analysis predictor profile (#13896)
6 years ago
tensor-tang dc5a7b906d fix default number of threads when inference with or without MKLDNN
6 years ago
Michal Gallus 09d9d77a8f Enable MKLDNN in Naive Executor
6 years ago
luotao1 9cbf2023ab rollback paddle_inference_helper.h to helper.h
6 years ago
luotao1 a989a4e7c2 refine paddle_inference_helper.h
6 years ago