lijianshe02
de26df440b
add SaveOptimModel interface in analysis_predictor.h and test it in a… ( #16441 )
...
* add SaveOptimModel interface in analysis_predictor.h and test it in analyzer_dam_tester and analyzer_resnet50_tester test=develop
6 years ago
Wojciech Uss
09dfc7a2aa
C-API quantization core 2 ( #16396 )
...
* C-API quantization core
test=develop
Co-authored-by: Sylwester Fraczek <sylwester.fraczek@intel.com>
* Decouple Quantizer from AnalysisPredictor
test=develop
* fixes after review
test=develop
* renamed mkldnn quantize stuff
test=develop
* remove ifdef from header file
test=develop
6 years ago
nhzlx
69d37f81d7
cherry-pick from feature/anakin-engine: refine anakin subgraph. #16157
...
support change input size
6 years ago
nhzlx
3c40cb767b
7 refine zero copy
...
update trt in docker file
test=develop
6 years ago
nhzlx
2eff3e26b6
Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into add_static_model_load_for_trt
6 years ago
nhzlx
06a088a199
fix comments and fix cpplint
...
test=develop
6 years ago
nhzlx
0ed63b2108
6. delete useless predictor id
...
test=develop
6 years ago
Sylwester Fraczek
8bc604571f
fix typo seriazlized->serialized
6 years ago
nhzlx
2070fb246d
4. do the trt_engine optim during init.
...
add simple static mode loading
test=develop
6 years ago
Yan Chunwei
655179089f
AnalysisConfig remove contrib namespace ( #15540 )
6 years ago
Yan Chunwei
526790e652
infer get program ( #15511 )
6 years ago
Zhaolong Xing
97b76c94c4
Merge pull request #15242 from NHZlX/trt_int8_ultimate_version
...
add trt int8 support
6 years ago
Yan Chunwei
e2818c8608
add dynamic memory optim ( #15457 )
6 years ago
nhzlx
027d24c831
Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into trt_int8_ultimate_version
6 years ago
flame
d60751fb71
add python inference api ( #15248 )
...
add python inference api
6 years ago
Yan Chunwei
885c4e57ab
fea/infer memory optim2 ( #14953 )
6 years ago
Yan Chunwei
e84234b551
make clone thread safe ( #15363 )
6 years ago
nhzlx
312fe0ece1
add trt int8 calibration support
...
fix comments
test=develop
6 years ago
nhzlx
4e3522e5b4
add trt int8 support
...
test=develop
6 years ago
Yan Chunwei
d09d6eadc0
make inference api work with Doxygen ( #15195 )
6 years ago
Yiqun Liu
726f2cefe3
Fix bug of referencing a temporary variable. ( #14614 )
...
test=develop
6 years ago
luotao1
116979a40a
refine api name
...
test=develop
6 years ago
luotao1
a5c4b463c9
add SetMKLDNNThreadId api
6 years ago
Yan Chunwei
9f252e0032
Combine Inference Analysis with IR ( #13914 )
6 years ago
qingqing01
abe209234f
Exhaustive search for cuDNN conv. ( #14286 )
...
* exhaustive search for cuDNN conv.
* Refine code and add unit testing.
* Fix model load in fluid/inference and unit testing in conv2d
* Follow comments.
* Fix compiling test=develop
6 years ago
qingqing01
db8c52da5e
Revert " Exhaustive search for cuDNN conv. ( #14043 )"
...
This reverts commit ce7d9b0799
.
6 years ago
qingqing01
ce7d9b0799
Exhaustive search for cuDNN conv. ( #14043 )
...
* exhaustive search for cuDNN conv.
* Refine code and add unit testing.
* Clean code
* Fix model load in fluid/inference and unit testing in conv2d
* Follow comments.
6 years ago
Yan Chunwei
ee74be3a49
[1.1] Bugfix/tensorarray ( #14044 )
6 years ago
Yan Chunwei
6809238d97
fix analysis predictor profile ( #13896 )
7 years ago
Yan Chunwei
c8744d118d
fea/infer executor and concurrency performance issue bug fix ( #13451 )
...
- add naive executor
- fix concurrency performance issue
7 years ago
Yan Chunwei
5de14c6b96
refine inference api ( #13518 )
7 years ago
Yan Chunwei
9df2d8b5ba
test/add text-classification test ( #13081 )
7 years ago
Yan Chunwei
af15f6f038
fea/refine fuse ( #13076 )
7 years ago