126 Commits (887a39f05047b3aa9f51e41f64e9c4cbea72d37f)

Author	SHA1	Message	Date
Zhen Wang	3398f99608	Adding AddQuantDequantPass for TensorRT int8 (#17529) ... * add quant_dequant_pass, test=develop * Add quant_dequant before some ops, such as the elementwise_add op. This is required by TensorRT. test=develop	6 years ago
Yibing Liu	f9796b1249	Add LAMB Optimizer support (#17489) ... * Add LAMB optimizer * Expose LAMB Optimizer's APIs test=develop, test=document_preview * Cleanup code & doc test=develop, test=document_preview * Update lamb optimizer's formula test=develop	6 years ago
Jie Fang	30e178fa2c	init auto loss scaling (#17194) ... * init auto loss scaling test=develop * change API.spec * change ifelse to switch and use reduce_sum to optimize checking isfinite test=develop * Remove redundant code test=develop	6 years ago
guomingz	6d1d7c8acf	Fix the KL algorithm bug when calculated the size of tensor. (#17198) ... * resolve #17184 Fix the KL algorithm bug when calculated the size of tensor. * Add the missing test=develop. test=develop	6 years ago
Zhen Wang	65541d83b0	add scale pass for calculating the output scales.test=develop (#17259)	6 years ago
Zhen Wang	a40121e4c8	fix the initialization process error. test=develop (#17213)	6 years ago
wopeizl	06325c4de1	disable the test_distillation_strategy temporarily (#17227) ... test_distillation_strategy always failed on a machine with 4 gpus only, disable temporarily and need to figure out the root cause and add it back later	6 years ago
guomingz	e4a52e082f	resolve #17159 (#17172) ... Update the folder name generation mechanism for saving the quantized model and weights. The folder name would be unique by adding the timestamp postfix. test=develop	6 years ago
Yibing Liu	beda78258f	Init mixed precision training interface (#16856) ... * Init mixed precision training interface * Add fp16 test script test=develop * All initializers support float16 test=develop * Code cleanup & add more code annotations test=develop * Update API spec test=develop * Add usage example in doc test=develop	6 years ago
Zhen Wang	b8c166f632	Merge pull request #17029 from wzzju/add_graph_checkpoint ... add checkpoint functions for graph. test=develop	6 years ago
Zhen Wang	bf6b9d6d37	add checkpoint functions for graph. test=develop	6 years ago
Wang, Chuanqi	45ebafc33e	Split test_calibration test to two tests (#16977) ... * Split test_calibration test to two tests test=develop * Modify CMakeLists file test=develop	6 years ago
whs	486f7d8ed6	Restore quantization and distillation stategy before loading persistables. (#16958) ... test=develop	6 years ago
Tao Luo	bc037c13c7	use multi-thread to speedup CI tests ... test=develop	6 years ago
chuanqiw	1818d1d9f0	Reduce test_calibration test time by using large batchsize ... test=develop	6 years ago
AIFollowers	fb1ae722d1	Fix model_stat importing in paddle/fluid/contrib	6 years ago
chengduo	bb80dae7d0	Add DecoupledWeightDecay (#16427) ... * Add DecoupledWeightDecay	6 years ago
whs	73c4f2b7b6	Fix distillation for soft label. (#16538) ... test=develop	6 years ago
Zhen Wang	4c1ec41de3	Merge pull request #16531 from wanghaoshuang/quan_ck ... [slim] Fix checkpoint of quantization strategy.	6 years ago
AIFollowers	e18ab78f67	add model_stat.py (#16512) ... * Add a tool to summary model's PARAMS, FLOPs in paddle/fluid/contrib.	6 years ago
wanghaoshuang	d41b623a72	Merge branch 'develop' of https://github.com/PaddlePaddle/paddle into quan_ck ... test=develop	6 years ago
wanghaoshuang	6db7c2a500	Fix checkpoint of quantization.	6 years ago
Zhen Wang	f86429dbd9	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into fix_slim_quant_bugs ... test=develop	6 years ago
whs	679a4c28fc	Fix lost of learning rate variable in distillatoin when using lr decay. (#16471) ... test=develop	6 years ago
Zhen Wang	6b854f3e1f	fix the save_in_nodes bug.	6 years ago
Zhen Wang	183bacebe3	clean codes and fix some bugs. test=develop	6 years ago
Tao Luo	1b4e4e7ef7	Merge pull request #16453 from chuanqi129/calibration_readme_refine ... Update INT8 calibration README	6 years ago
liuwei1031	8d22bc17a4	Memory optimize (#16410) ... * fix cdn issue, test=develop * fix memory optimize bugs, test=develop * fix memory optimize bugs, test=develop * remove add/sub_2 op, test=develop * disable memory_optimize by default, test=develop * disable inplace activation in python, test=develop * fix unittests, test=develop * fix unittests, test=develop * bug-fix, test=develop	6 years ago
chuanqiw	c512516ff4	Update INT8 calibration README ... test=develop	6 years ago
Zhen Wang	27d05203e7	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into fix_quan_hang ... test=develop	6 years ago
Zhen Wang	1c11f817e9	Use the resolve hazard method.	6 years ago
Wang, Chuanqi	85e1cc1e02	Update Readme with new accuracy and performance data measured on 6271 (#16437) ... * Update Readme with new accuracy and performance data measured on 6271 test=develop * Modify tables and example command test=develop	6 years ago
whs	e9bec9369b	[slim] Add quantization strategy and distillation strategy. (#16408) ... * Add fsp operator. 1 Add unitest. 2. Add python API. 3. Add layer test. * Add quantization strategy. 1. Add API. 2. Add unitest. * Add distillatoin strategy. * Add unitest config file for quantization * Fix Copyright test=develop * Fix setup.py * Fix document of layers.py. test=develop * Fix unitest in python3. test=develop * Fix documents. test=develop * 1. refine fsp op by batched gemm 2. remove unused import test=develop * Fix test_dist_se_resnext. 1. disable test distillation. 2. reset framework.py test=develop * Enable unitest of distillation after fixing Block._clone_variable test=develop * Fix cdn issue. test=develop	6 years ago
Zhen Wang	2ccbfd5e10	Fix some bugs for quantization passes.	6 years ago
liuwei1031	de3b70a101	fix cdn issue, test=develop (#16423) ... * fix cdn issue, test=develop * fix cdn issue, test=develop	6 years ago
chuanqiw	431068c9ca	Enhance test calibration script on accuracy assert ... test=develop	6 years ago
whs	2e5831f0dc	[slim] Refine framework of slim and add filter pruning strategy (#16226) ... * First pr of paddle slim. 1. Add framework of paddle slim 2. Add filter pruning strategy test=develop * Rename unitest to tests. test=develop * Add prettytable into requirements. test=develop * Change in_nodes and out_nodes to odered dict. test=develop * Remove distillation. test=develop * Fix API.spec test=develop * Fix unitest. test=develop * Fix unitest in windows. test=develop * Fix unitest in windows. test=develop * Fix unitest. test=develop * Hide some functions. test=develop * Fix python import in python3.5 test=develop * Fix compress pass. test=develop * Fix unitest of test_dist_ctr. test=develop * Enhence flops. * use os.path.join * Fix pickle for python3 Fix log and comments. test=develop * 1. Remove feed_reader in compress pass 2. Fix cache reader 3. Rename CompressPass to Compressor 4. Add comments for distiller optimizer 5. Remove unused pruner currently 6. Add some comments. 7. Change API.spec test=develop * Fix pruning in python3. test=develop * Fix unitest in python3. test=develop * Fix format in python3. test=develop	6 years ago
Zhen Wang	ec11135d54	Merge pull request #16341 from wzzju/add_channel_wise_in_quant_pass ... Add channel wise in quant pass.	6 years ago
Zhen Wang	8965819fbb	rewrite the cuda kernels of channel_wise_quant_op and channe_wise_dequant_op. test=develop	6 years ago
Zhen Wang	ec88b6cc5a	add channel wise quantization in ir pass.	6 years ago
tangwei12	8ea4218ce1	update load persistables for increment, test=develop (#15576) ... * update load persistables for increment, test=develop * update load persistables for increment, test=develop * update API Spec, test=develop * update API Spec, test=develop * add doc, test=develop * add doc, test=develop * Update lookup_table_utils.py * Update API.spec * Update lookup_table_utils.py test=develop * Update API.spec test=develop * fix api spec * Update lookup_table_utils.py test=develop	6 years ago
achao2013	81b4fad8b9	add moving average absmax op and fix bug (#15155) ... * Add moving average absmax op in quantilize-aware training.	6 years ago
Zhen Wang	41b8cf0bae	Merge pull request #16162 from wzzju/fix_nan_static_quant ... Fix NaN bugs for static quantization strategy (mutil-cards train).	6 years ago
Zhen Wang	b8d1f5038e	Add the executor test for the graph clone API. test=develop	6 years ago
Zhen Wang	4ab0607634	fix NaN bugs.	6 years ago
Zhen Wang	ac6ef06ffa	Add the Clone method in Graph. test=develop	6 years ago
Zhen Wang	1b9c8d5f06	add clone function for IrGraph. test=develop	6 years ago
Zhen Wang	3cf0ee414d	update some details. test=develop	6 years ago
Zhen Wang	0cb50bb983	avoid ce fails on windows.	6 years ago
Zhen Wang	7c8f7df2fe	add some op_des funs to IrOpNode and add some var_des funs to IrVarNode. test=develop	6 years ago