380 Commits (dcce54ea76be48cb3a6ac398b7d9569e996ac054)

Author	SHA1	Message	Date
tangwei12	ebbdf52557	fix entry (#31079) ... * fix entry * fix distributed lookup table fuse case * fix entry bug at first time * move entry from paddle.fluid -> paddle.distributed * fix ut with paddle.enable_static() Co-authored-by: malin10 <malin10@baidu.com>	4 years ago
Zhen Wang	71acde9afc	Use correct master weights in AdamW. (#30895) ... * Use correct master weights in AdamW. * Just modify the master weight. * Update for CI Coverage.	4 years ago
yingshengBD	0eea5d714f	post quantize support insert fake_quantize_dequantize node before the OPs that will be used in VIS's faceid models (#30659) ... test=develop	5 years ago
guofei	430f8449f1	Fix the error of save_quantized_model (#30583) ... * Fix the error of save_quantized_model	5 years ago
huangxu96	138620084c	Add fleet amp_init() (#30572) ... * add fleet amp.init() * add unittest for fleet_amp_init	5 years ago
cc	ce6777fcdf	Fix bug of supporting channelwise dygraph quantized model, test=develop (#30531)	5 years ago
cc	5d8d463cf7	Collect weight threshold for lstm op in post_training_quantization (#28701) ... * Collect weight threshold of lstm, test=develop	5 years ago
cc	8e3a294045	skip quantizing ops in cpu inference (#30342) ... * skip quantizing ops in cpu inference, test=develop	5 years ago
Bai Yifan	ad6fee2fa8	fix quantize error in speical naming model (#30354)	5 years ago
huangxu96	342d62de60	add amp example document (#30314)	5 years ago
huangxu96	ee623bff64	Implemented AddQuantDequantPass in imperative quantization. (#26692) ... * Implemented AddQuantDequantPass in imperative quantization. * Supported LeakyReLU Quantization * For meeting coverage rate. * Changed the file name of test of AddQuantDequant * Implemented more Quantized NoWeightLayers. * Fix the loss cannot align problem between static and dynamic model quantization, add swish as supported quantized layer in imperative quantization. * remove noweight_list * support 2.0 API such as Pool2D and ReLu	5 years ago
tangwei12	5e839e4da5	add sparse embedding & load vars for 2.0 & gloo bug fix (#30306) ... * add sparse embedding & load vars for 2.0 Change-Id: I36b59ed5f015189dc9d9d2e34a9357722d369f1b * fix hdfs gloo Change-Id: Ia84d579053720ad804183e54c9a04b4f031c79c6 * fix gloo hdfs Change-Id: I5ab982fd483cddc10adcdef0b8aa83aca976cb9e * move loadvar/sparse embedding from incubute to static Change-Id: I57081d3545ad2efab78c72420d2162c0eacaf3a0	5 years ago
Zhen Wang	7f7dfccf20	Support pure fp16 training for AMP API. (#29544) ... * add cast ops before and after unsupported fp16 ops. * Keep partial net in FP32 pattern. * Support check_finite_and_unscale and update_loss_scaling for FP16 calculation mode. * Add fp16 support for adam op. * add multi precision attr for adam. * Fix the bug of test_multi_precision_fp16_train UT. * Code format for CI. * Fix the redefine error about MPTypeTrait on windows. * fix bugs of the _create_accumulators func in Momentum. * fix bug when inserting post cast op. * Add the update_loss_scaling op in allow_set of UnusedVarCheck. * Update for ci coverage. * Add some doc for OptimizerWithMixedPrecision. * Fix the code style. * Imporve the doc of `amp_init`. * Change for fp16 testing if users have the infer program defined in separate way.	5 years ago
guofei	1bdf924217	Quantization supports 2.0 APIs (#30036) ... * Quantization supports 2.0 APIs * Fix the error of save_quantized_model	5 years ago
wangchaochaohu	7dd551e08b	refine the paddle place support using str (#28769)	5 years ago
WangXi	ab04997846	[fleet] combine amp and gradient merge, test=develop (#30086)	5 years ago
cc	1fa863da40	Support dygraph quant model (#29927) ... * Avoid the scale to be infinity in quant2_int8_mkldnn_pass, test=develop * support quantized model for paddle2.0 dygraph, test=develop	5 years ago
cc	62f455e023	Support quantizing program_desc (#29526) ... * Support quantizing program_desc, test=develop	5 years ago
guofei	8212874f47	Fix test_imperative_skip_out (#29939) ... * Fix unittest:test_imperative_skip_out	5 years ago
XiaoguangHu	726c78f293	clean redundant API alias in 2.0 - part 1 (#29928) ... * rm check_import_scipy, rm chunk_eval and mean_iou in paddle.metric.__init__.py * Revert "rm check_import_scipy, rm chunk_eval and mean_iou in paddle.metric.__init__.py" This reverts commit 179ba8c2b22bc31fe8d8a126e31820792cbd0f4e. * delete paddle.metric.chunk_eval and paddle.metric.mean_iou * delete paddle.nn.clip and paddle.nn.clip_by_norm * delete paddle.nn.functional.activation.hard_sigmoid and paddle.nn.functional.activation.hard_swish * delete paddle.nn.Pool2D, paddle.nn.BilinearTensorProduct, paddle.nn.RowConv, paddle.nn.functional.row_conv * fix extension import error * fix unittest for row_conv and Pool2D	5 years ago
cc	61820fd217	add the time threshold of quantization tests, test=develop (#29786)	5 years ago
huangxu96	a29006d128	Optimizer trans momentum (#29597) ... * merge amp related function in Momentum from paddle.fluid.contrib.optimizer into paddle.optimizer. * Add unittest for 2.0 Momentum API. * fix some bugs in weight_decay.	5 years ago
huangxu96	97e29411eb	fix a bug in multi_precision_fp16 unittest. (#29756)	5 years ago
huangxu96	b96dada4f0	add static.amp into setup.pu.in (#29621) ... * add static.amp into setup.pu.in * add unittest for api	5 years ago
huangxu96	c05170d3d8	add alias for fluid.contrib.mixed_precision (#29562) ... * add alias for fluid.contrib.mixed_precision	5 years ago
Wojciech Uss	917a11495f	fix ininite scale values (#29386)	5 years ago
Aurelius84	5d530c9319	fix amp support fleet (#29491)	5 years ago
LoveAn	03b42d9fa7	fix unittest on windows, test=develop (#29365)	5 years ago
Zhen Wang	be3777a50a	Add pure fp16 training with master weights. (#27712) ... * add the weight decay func for the momentum op * Add the multi_precision function in Momentum Optimizer. * Make sure that the initial value of master weights are same with the fp16 weights. * add static loss scaling. * add the rescale_grad function in the pure fp16 training. * use the original momentum updating method. * Polish some codes, such as variable names. * add docstring for apis. * update the var creation details of _create_master_weight. * not modify codes about imperative momentum updating. * Fix the error of test_dist_sparse_tensor_load_momentum UT. * add unit test for multi precision fp16 training. * add more unit tests for CI. * Use lower threshold values for allclose comparing in test_multi_precision_fp16_train UT. * For CI Coverage Checking.	5 years ago
furnace	7584bb5096	Layer norm fp16 (#29169) ... * add fp16 for layer_norm op * revert layernorm api * fix forward * fix forward * fix backward for layernorm with fp16 * fix unit test for layernorm with fp16 * fix with_mkldnn compile error for layernorm with fp16 * 1. revert to PADDLE_ENFORCE_NOT_NULL, 2. change static_cast<float> to static_cast<U> * fix with_mkldnn compile error for layernorm with fp16 * fix with_mkldnn compile error for layernorm with fp16 Co-authored-by: zhiqiu <chenqiuliang@baidu.com>	5 years ago
Leo Chen	4556ad76b4	Upgrade string literals to raw string [part 2](#29217)	5 years ago
WangXi	0c2a51d240	optimizer amp, all use fp16 communication, overlap last comm and compute (#28957)	5 years ago
Wojciech Uss	4fd4095d1b	Add quantization of multi_gru op and tests (#28615)	5 years ago
guofei	638402274a	Integrate ImperativeOutScale into ImperativeQuantAware. (#27956) ... * Optimiz the unittest test_imperative_out_scale test=develop	5 years ago
Aurelius84	14013a2eba	Remove prettytable in requirements.txt (#29100)	5 years ago
huangxu96	40f5453725	Quant nn2.0 (#28764) ... * Impelement 2.0 API version Conv2d and Linear layer quantization in imperative mode. * use cudnn softmax in static Lenet * Modified ChannelwiseQAT Unittest for 2.0 API. * For CI python coverage.	5 years ago
Leo Chen	3815d7aa40	Upgrade string literals to raw string (#28989) ... * upgrade comment string to raw string * fix string in * fix string with ' ' * revert update on comments * upgrade only necessary * fix sample code checker * fix comments with '''	5 years ago
furnace	8ff3550658	refactor momentum op to combine weight (#27414) ... * refactor momentum op to combine weight_decay (scale op and sum op)	5 years ago
Chen Weihang	358d6bc90f	Fix test_weight_decay_extend random failed on windows (#28643) ... * add debuging code * change seed & add debug message	5 years ago
Bai Yifan	5050e761b8	Support user-defined activation/weight quantize and preprocess. (#28570) ... * support user-defined quant and preprocess	5 years ago
Leo Chen	11e32baf1e	Add matmtl_v2 to amp list (#28693) ... * add matmtl_v2 to amp list * support dygraph	5 years ago
cc	d1e84f3e9e	Add some ops for cacluating output scale, test=develop (#28644)	5 years ago
YUNSHEN XIE	ba0756325a	exec ut no more than 15s 1 (#28439) ... * disable ut test_parallel_executor_fetch_isolated_var,test=document_fix * test for limiting ut exec time as 15S * fix an error caused by cannot find ut * fix some error * can not find test_transformer * fix error caused by ut not run in windows * fix error caused by Compiler Options * fix error caused by setting timeout value as 15 in python/paddle/tests/CMakeLists.txt * setting timeout value to 120s for old ut * add the timeout value setting * fix error caused by ut only run in coverage_ci * add analyzer_transformer_profile_tester * fix some error * fix some error * fix error with inference option * fix error with inference option setting as ON_INFER * add some ut to set timeout * modified some option * fix error * fix some timeout error * fix error * fix error * fix timeout for test_analyzer_bfloat16_resnet50 * fix error * setting timeout properity for some ut * first pr for new ut timeout as 15S	5 years ago
Leo Chen	71d6220772	Skip reader op in mixed_precision decorator (#28353) ... * skip reader op in mixed_precision decorator * add ut	5 years ago
Chen Weihang	5d73bfdb98	fix test_weight_decay_extend error (#28178)	5 years ago
cnn	7c1aa0d69d	2.0rc api rename (#28088) ... * rename manual_seed to seed * rename xxx1d-->xxx1D, xxx2d-->xxx2D, xxx3d-->xxx3D * rename manual_seed --> seed * do not rename .cc, .cu and .h file * rename manual_seed --> seed * rename manual_seed --> seed * rename manual_seed --> seed * rename manual_seed --> seed * disable_static on doc example code * donot change manual_seed on generator * add enable_static on sample code * convert python/paddle/fluid/layers/nn.py to bak * fix typo * fix code style * fix seed to manual_seed when call functions of Generator() * fix bug	5 years ago
guofei	6bbb6e7f45	Implement the function of OutScaleForTraining/OutScaleForInference in dygraph (#26601) ... * Implement the function of OueScaleForTraining/OutScaleForInference in dygraph test=develop	5 years ago
WangXi	0a1862d1d2	fleet combine amp dgc recompute meta optimizer (#27643)	5 years ago
cc	8fabb1c32f	Add test attribute in channelwise_quant op, test=develop (#27742) ... * Add test attribute in channelwise_quant op, test=develop	5 years ago
Chen Weihang	9b49f02441	Polish jit.save/load design & remove paddle.SaveLoadConfig (#27623) ... * replace config by kwargs * change save path form dir to prefix * fix failed unittests * revert unittest name change * polish en docs * add more tests for coverage	5 years ago