52 Commits (cdba41af4dfd7d58cf90617531a95adcb3318211)

Author	SHA1	Message	Date
juncaipeng	1f57ac1241	delete concat in AddQuantDequantPass, test=develop (#21454)	7 years ago
lidanqing	c0aa13672e	Fp32 vs int8 qat C++ performance (#21244) ... * add ut for comparing FP32 and QAT INT8 * add save qat transformed model python script test=develop * updated * added missing file * add "with_label" test=develop * performance benchmark as unit test test=develop * change names of unnecessary thing * Change CMakeList.txt for model downloading and UT test=develop * change names of functions and params for more readable code test=develop * Change PADDLE_ENFORCE messages test=develop * fix indent problems test=develop * indent problems test=develop	7 years ago
itminner	07e6a94268	paddleslim quantization skip pattern support list of string (#21141)	7 years ago
juncaipeng	84865b806b	add resnet50 test for post trainint quantization, test=develop (#21272)	7 years ago
juncaipeng	29b63f0aa1	support set model_filename and params_filename in post_training_quantization, test=develop (#21213) ... * support set model_filename and params_filename in post_training_quantization, test=develop	7 years ago
juncaipeng	00b11a4a1e	Support more ops in post training quantization, test=develop (#21073) ... * Support more ops in post training quantization, and save the output scale in quantized op. * Update docs in post training quantization and qat	7 years ago
joanna.wozna.intel	37e0e7a96b	QAT int8 accuracy little improvement (#21074) ... test=develop	7 years ago
juncaipeng	fa522dffa0	Fix bug in add_quant_dequant_pass, test=develop (#21018) ... * Fix bug for inserting add_quant_dequant_op to same variable repetitively in add_quant_dequant_pass, test=develop	7 years ago
juncaipeng	175ba39c03	Add post_training_quantization (#20800) ... * add post training quantization, test=develop * specify the quantizable op type, test=develop	7 years ago
juncaipeng	f201b465ec	Move pool2d to add_quant_dequant_pass, test=develop (#20586) ... * move pool2d to add_quant_dequant_pass, test=develop	7 years ago
Liufang Sang	86c2c362ae	fix fuse_reduce_op quantization bug (#20306) ... * fix fuse_reduce_op quantization bug test=develop * close fuse_all_reduce_ops in PaddleSlim, test=develop	7 years ago
Michał Gallus	540935a825	[Bug-fix][1.6] Improve QAT accuracy (#20174) ... * Leave fake quantization around mul * Replace Fake with Real Quantized Mul * Gather all scales from fake_quantize_ops * Enable uint8 in conv_relu tensors * Disable int8 mul and restore fake mul * Fix buf for running QAT on VGG16 and 19	7 years ago
bingyanghuang	9de6772510	Follow comment of Merged QAT PR 18970 (#19979) ... * Follow Wangzhen's comment in PR 18970, test=develop * Review comments, test=develop * Leave fake quantization around mul test=develop * Replace Fake with Real Quantized Mul test=develop * Fix bug in quantize placement pass Nodes in the graph now have checked type instead of node name when they are to be marked for quantization test=develop	7 years ago
Wojciech Uss	4286a6270d	Add support for new QAT models (#18970) ... * Add support for new QAT models test=develop Co-Authored-By: Michał Gallus <michal.gallus@intel.com> Co-Authored-By: Wojciech Uss <wojciech.uss@intel.com> * fixed fps results test=develop * fix top5 accuracy drop problem * updated for new QAT models * skip quantizing average pooling - dirty but working * add missing pass * added missing conv+brelu fuse pass * removed a call to non-existent pass test=develop * renamed pass test=develop * Adjust finding pooling scale to newest QAT models * Remove unnecessary code from quantization_mkldnn_pass * Copy Pooling input scale to output scale in QAT * Refactor & remove unused code in QAT * Incorporate fp32 FC into QAT test=develop * Enable graph drawing with debug flag test=develop * Add tests for QATv2 * Fix paths for QATv2 models test=develop * Add option to save transformed int8 qat model test=develop * Remove redundant lines from qat mkldnn pass test=develop * Delegate disablement of avg pooling to qat test=develop * fix CI bug, test=develop * Follow Wangzhen's Review, test=develop * Update API.spec test=develop * Name False in (is_unsigned, TensorScale) tuple test=develop	7 years ago
whs	bdb3e376d0	[PaddleSlim] Enhence compressor api in PaddleSlim (#19894) ... 1. Support customize eval function instead of eval program. 2. Fix loading checkpoint in quantization strategy. 3. Support saving eval model when saving a checkpoint. 4. Fix decoder of loading context in PaddleSlim. 5. Fix restoring from the checkpoint of uniform prune strategy. 6. Support saving eval model and infer model during training. 7. Add ‘unitest’ for saving eval model, saving infer model and uniform pruning restoring from the checkpoint. 8. Fix pruning of depthwise_conv_grad op by updating the groups.	7 years ago
juncaipeng	b0ceed6fb4	add fake_quant_dequant_op for average pool2d, test=develop (#19880) ... * add fake_quant_dequant_op for average pool2d * add test	7 years ago
lidanqing	ba368bf696	clean up intel labeled TODOs (#19476) ... test=develop	7 years ago
liu zhengxi	32598ffd8f	Python infer api update and add unit test (#19353) ... * python inference api supports numpy and add unit test, fix unit test fail in test_slim_int8_googlenet and test_slim_int8_mobilenet	7 years ago
Zhen Wang	0fe72469ea	Add the max-pool2d quantization support and the partial quantization support. (#19310) ... * add pool2d quantization support, only for max-pooling. * add the partial quantization support.	7 years ago
bingyanghuang	a25be53cb5	QAT int8 MKL-DNN transformation pass with MUL (#18322)	7 years ago
翟飞跃	802ea50956	fix spelling errors (#17941) ... * fix spelling errors; test=develop * Update API.spec update md5 * Update API.spec * change the order of api;test=develop	7 years ago
Kaipeng Deng	96ee528e3e	fix logging basicConfig cannot be setting after import paddle (#17786) ... * fix logging unable. test=develop * unset sys.stdout for stream handler. test=develop * fix newly add basicConfig. test=develop * fix import error. test=develop	7 years ago
bingyanghuang	90ebce9ead	QAT int8 MKL-DNN transformation pass (#17819)	7 years ago
翟飞跃	993c703bcc	INT8 MKL-DNN v2 integrate to slim (#17634) ... * refactor PR 16865 * delete mergetool files * test=develop * test=develop * test=develop * test=develop * create dir for int8 model before call SaveOptimModel * test=develop * mkldnn int8 only support linux; test=develop * refine code; test=develop * remove comment; test=develop * refine code; test=develop * fix bug; test=develop * add exception for mkldnn_post_training_strategy * reuse int8v2 CAPI dataset; test=develop * fix accuracy check bug; test=develop * remove tab * convert files to unix format * test=develop * reduce CI time;test=develop * reduce CI time and refine code;test=develop * refine comment; test=develop * add cmake FLAGS;test=develop * remove predict_num;test=develop	7 years ago
Zhen Wang	3398f99608	Adding AddQuantDequantPass for TensorRT int8 (#17529) ... * add quant_dequant_pass, test=develop * Add quant_dequant before some ops, such as the elementwise_add op. This is required by TensorRT. test=develop	7 years ago
Zhen Wang	65541d83b0	add scale pass for calculating the output scales.test=develop (#17259)	7 years ago
Zhen Wang	a40121e4c8	fix the initialization process error. test=develop (#17213)	7 years ago
whs	486f7d8ed6	Restore quantization and distillation stategy before loading persistables. (#16958) ... test=develop	7 years ago
wanghaoshuang	d41b623a72	Merge branch 'develop' of https://github.com/PaddlePaddle/paddle into quan_ck ... test=develop	7 years ago
wanghaoshuang	6db7c2a500	Fix checkpoint of quantization.	7 years ago
Zhen Wang	6b854f3e1f	fix the save_in_nodes bug.	7 years ago
Zhen Wang	183bacebe3	clean codes and fix some bugs. test=develop	7 years ago
Zhen Wang	27d05203e7	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into fix_quan_hang ... test=develop	7 years ago
Zhen Wang	1c11f817e9	Use the resolve hazard method.	7 years ago
whs	e9bec9369b	[slim] Add quantization strategy and distillation strategy. (#16408) ... * Add fsp operator. 1 Add unitest. 2. Add python API. 3. Add layer test. * Add quantization strategy. 1. Add API. 2. Add unitest. * Add distillatoin strategy. * Add unitest config file for quantization * Fix Copyright test=develop * Fix setup.py * Fix document of layers.py. test=develop * Fix unitest in python3. test=develop * Fix documents. test=develop * 1. refine fsp op by batched gemm 2. remove unused import test=develop * Fix test_dist_se_resnext. 1. disable test distillation. 2. reset framework.py test=develop * Enable unitest of distillation after fixing Block._clone_variable test=develop * Fix cdn issue. test=develop	7 years ago
Zhen Wang	2ccbfd5e10	Fix some bugs for quantization passes.	7 years ago
Zhen Wang	8965819fbb	rewrite the cuda kernels of channel_wise_quant_op and channe_wise_dequant_op. test=develop	7 years ago
Zhen Wang	ec88b6cc5a	add channel wise quantization in ir pass.	7 years ago
achao2013	81b4fad8b9	add moving average absmax op and fix bug (#15155) ... * Add moving average absmax op in quantilize-aware training.	7 years ago
Zhen Wang	7c8f7df2fe	add some op_des funs to IrOpNode and add some var_des funs to IrVarNode. test=develop	7 years ago
Zhen Wang	33f99d6197	add IrNode&IrVarNode&IrOpNode. test=develop	7 years ago
WangZhen	28dfad5e27	fix some bugs about python3. test=develop	7 years ago
WangZhen	a7efab7ec1	add comments for public API. test=develop	7 years ago
WangZhen	0db41a9c44	add op_role attr when creating op node.	7 years ago
WangZhen	c64f22048a	add convert_to_int8 pass and transform_for_mobile pass and their UTs.	8 years ago
WangZhen	c8095eeb82	add freeze pass, and UT is passed.	8 years ago
WangZhen	dde19a0ff8	add quantization freeze pass.	8 years ago
WangZhen	3b668c1574	Update some comments in the quantization transform pass. test=develop	8 years ago
WangZhen	b913463e83	Update according to the reviewers' suggestion. test=develop	8 years ago
WangZhen	59e5cc51d6	Add quantization transform pass and UT.	8 years ago