354 Commits (0ce6d7fa77a4c19e6da33b8afcef265641f2e291)

Author	SHA1	Message	Date
Aurelius84	5d530c9319	fix amp support fleet (#29491)	6 years ago
LoveAn	03b42d9fa7	fix unittest on windows, test=develop (#29365)	6 years ago
Zhen Wang	be3777a50a	Add pure fp16 training with master weights. (#27712) ... * add the weight decay func for the momentum op * Add the multi_precision function in Momentum Optimizer. * Make sure that the initial value of master weights are same with the fp16 weights. * add static loss scaling. * add the rescale_grad function in the pure fp16 training. * use the original momentum updating method. * Polish some codes, such as variable names. * add docstring for apis. * update the var creation details of _create_master_weight. * not modify codes about imperative momentum updating. * Fix the error of test_dist_sparse_tensor_load_momentum UT. * add unit test for multi precision fp16 training. * add more unit tests for CI. * Use lower threshold values for allclose comparing in test_multi_precision_fp16_train UT. * For CI Coverage Checking.	6 years ago
furnace	7584bb5096	Layer norm fp16 (#29169) ... * add fp16 for layer_norm op * revert layernorm api * fix forward * fix forward * fix backward for layernorm with fp16 * fix unit test for layernorm with fp16 * fix with_mkldnn compile error for layernorm with fp16 * 1. revert to PADDLE_ENFORCE_NOT_NULL, 2. change static_cast<float> to static_cast<U> * fix with_mkldnn compile error for layernorm with fp16 * fix with_mkldnn compile error for layernorm with fp16 Co-authored-by: zhiqiu <chenqiuliang@baidu.com>	6 years ago
Leo Chen	4556ad76b4	Upgrade string literals to raw string [part 2](#29217)	6 years ago
WangXi	0c2a51d240	optimizer amp, all use fp16 communication, overlap last comm and compute (#28957)	6 years ago
Wojciech Uss	4fd4095d1b	Add quantization of multi_gru op and tests (#28615)	6 years ago
guofei	638402274a	Integrate ImperativeOutScale into ImperativeQuantAware. (#27956) ... * Optimiz the unittest test_imperative_out_scale test=develop	6 years ago
Aurelius84	14013a2eba	Remove prettytable in requirements.txt (#29100)	6 years ago
huangxu96	40f5453725	Quant nn2.0 (#28764) ... * Impelement 2.0 API version Conv2d and Linear layer quantization in imperative mode. * use cudnn softmax in static Lenet * Modified ChannelwiseQAT Unittest for 2.0 API. * For CI python coverage.	6 years ago
Leo Chen	3815d7aa40	Upgrade string literals to raw string (#28989) ... * upgrade comment string to raw string * fix string in * fix string with ' ' * revert update on comments * upgrade only necessary * fix sample code checker * fix comments with '''	6 years ago
furnace	8ff3550658	refactor momentum op to combine weight (#27414) ... * refactor momentum op to combine weight_decay (scale op and sum op)	6 years ago
Chen Weihang	358d6bc90f	Fix test_weight_decay_extend random failed on windows (#28643) ... * add debuging code * change seed & add debug message	6 years ago
Bai Yifan	5050e761b8	Support user-defined activation/weight quantize and preprocess. (#28570) ... * support user-defined quant and preprocess	6 years ago
Leo Chen	11e32baf1e	Add matmtl_v2 to amp list (#28693) ... * add matmtl_v2 to amp list * support dygraph	6 years ago
cc	d1e84f3e9e	Add some ops for cacluating output scale, test=develop (#28644)	6 years ago
YUNSHEN XIE	ba0756325a	exec ut no more than 15s 1 (#28439) ... * disable ut test_parallel_executor_fetch_isolated_var,test=document_fix * test for limiting ut exec time as 15S * fix an error caused by cannot find ut * fix some error * can not find test_transformer * fix error caused by ut not run in windows * fix error caused by Compiler Options * fix error caused by setting timeout value as 15 in python/paddle/tests/CMakeLists.txt * setting timeout value to 120s for old ut * add the timeout value setting * fix error caused by ut only run in coverage_ci * add analyzer_transformer_profile_tester * fix some error * fix some error * fix error with inference option * fix error with inference option setting as ON_INFER * add some ut to set timeout * modified some option * fix error * fix some timeout error * fix error * fix error * fix timeout for test_analyzer_bfloat16_resnet50 * fix error * setting timeout properity for some ut * first pr for new ut timeout as 15S	6 years ago
Leo Chen	71d6220772	Skip reader op in mixed_precision decorator (#28353) ... * skip reader op in mixed_precision decorator * add ut	6 years ago
Chen Weihang	5d73bfdb98	fix test_weight_decay_extend error (#28178)	6 years ago
cnn	7c1aa0d69d	2.0rc api rename (#28088) ... * rename manual_seed to seed * rename xxx1d-->xxx1D, xxx2d-->xxx2D, xxx3d-->xxx3D * rename manual_seed --> seed * do not rename .cc, .cu and .h file * rename manual_seed --> seed * rename manual_seed --> seed * rename manual_seed --> seed * rename manual_seed --> seed * disable_static on doc example code * donot change manual_seed on generator * add enable_static on sample code * convert python/paddle/fluid/layers/nn.py to bak * fix typo * fix code style * fix seed to manual_seed when call functions of Generator() * fix bug	6 years ago
guofei	6bbb6e7f45	Implement the function of OutScaleForTraining/OutScaleForInference in dygraph (#26601) ... * Implement the function of OueScaleForTraining/OutScaleForInference in dygraph test=develop	6 years ago
WangXi	0a1862d1d2	fleet combine amp dgc recompute meta optimizer (#27643)	6 years ago
cc	8fabb1c32f	Add test attribute in channelwise_quant op, test=develop (#27742) ... * Add test attribute in channelwise_quant op, test=develop	6 years ago
Chen Weihang	9b49f02441	Polish jit.save/load design & remove paddle.SaveLoadConfig (#27623) ... * replace config by kwargs * change save path form dir to prefix * fix failed unittests * revert unittest name change * polish en docs * add more tests for coverage	6 years ago
LielinJiang	9089841b6e	Fix bilateral inference shape bug (#26822) ... * fix bilateral bug	6 years ago
Wojciech Uss	966447e338	Added support for quantization of fusion_gru (#27518)	6 years ago
Chen Weihang	f2c97b6da5	replace dataset with fake data (#27519)	6 years ago
YUNSHEN XIE	66951ab2ea	modified timeout value for 4 ut (#27462)	6 years ago
Zhang Ting	906e7f921e	add fuse_bn_act op (#27230) ... * add fused_bn_add_relu op	6 years ago
pangyoki	827ac36faa	Use dygraph mode by default (#27443) ... * default open dygraph mode * fix CI-Mac * fix Mac-CI other unittest file * fix CI-Py3 * fix test_communicator_geo and test_buffer_shared_memory_reuse_pass * add enable_static to fix CI-Py3 * add enable_static to fix CI-coverage * delete try except	6 years ago
huangxu96	02606d45ef	Quant op dev (#25932) ... * Finished ChannelWiseQuantDequantAbsMaxOp and Passed unittests. * Finished channel-wise quantize strategy in imperative quantization. * Added Cuda code of ChannelWiseQuantDequantMaxAbsOP Add Cuda code of ChannelWiseQuantDequantMaxAbsOp * Add quant_axis for channel_wise quant. * fixed a bug in unnitests, which will not trigger axis = 1 case and cannot meet the coverage rate requirement. * Added some assert infomation and fixed some coding style mistakes.	6 years ago
Zhen Wang	d28162b97f	Remove save_quantized_model in ImperativeQuantAware. (#27240)	6 years ago
cc	2d8281d5ad	Remove the cache in post_traning_quantization, test=develop (#26450) ... * Remove the cache in post_traning_quantization, test=develop	6 years ago
Zhen Wang	d708b21074	Update amp_check_finite_and_scale_op and add an updating_loss_scaling op for static graph amp training. (#26240) ... * update amp_check_finite_and_scale_op for static_amp. * use amp_check_finite_and_scale in static graph amp. * update grads to zero when grads own infinite values(as for amp_checkout_finite_and_scale op). * add update_loss_scaling op in cpp. * add update_loss_scaling_op unit test. * update the doc of the check_finite_and_unscale op * Update the process of gradients updating skipping if the gradients have infinite values. * update the way to zero grads. * update test_update_loss_scaling_op.py * add log info when find infinite grads. * add the unit test for UpdateLossScaling Layer.	6 years ago
Zhen Wang	ece74c4cd4	Update the _get_fake_quant_type definition in imperative QAT. (#27222)	6 years ago
LielinJiang	8df5b4d608	Add correlation api to contrib (#27015) ... * add correlation api to contrib	6 years ago
Sylwester Fraczek	eb65877ce0	fix dimensions error for mobilenetv1_KL_quant (#26776) ... * fix dimensions error for mobilenetv1_KL_quant fixes AssertionError: The size of weight scales vector (1000) does not match the number of output channels (1024) in the weights tensor fc7_weights. add mul test * remove comment * add third case unit test	6 years ago
Zhen Wang	bcdbac1753	fix some cast error. (#26884)	6 years ago
YUNSHEN XIE	d8984a6b90	limit timeout value setting on linux (#26923)	6 years ago
qingqing01	f7fb4c2212	Move hapi to python/paddle root dir. (#26442) ... * Move hapi form paddle/incubate to paddle * Remove vision/datasets/utils.py and clean code * Add sample code for conll05 * Print pull path when saving model * Fix sample code after paramter_list of SGD is changed to parameters * Fix bug in wmt16 datase	6 years ago
Leo Chen	844583c8fd	Refine paddle.manual_seed (#26496) ... * refine manual seed * fix ci problem * fix unittests * fix unittest * set is_init_py=false in manual_seed * fix unittest * fix bernoulli_op * fix(unittest): change random_seed to manual_seed * 🐞fix(unittest): fix manual_seed * trigger ci * fix test_sentiment * fix test_imperative_save_load * fix test_uniform_random_op * fix test_uniform_random_op * fix test_jit_save_load * merge develop * fix manual_seed * fix manual_seed * use global engine * use shared_ptr * fix double free * fix bug * fix bug * fix bug * fix test bug * fix test bug * fix test bug * fix ci	6 years ago
Pei Yang	e3f8e5cf5c	trt int8 support conv2d_transpose (#26636)	6 years ago
chalsliu	dc56c89822	Add the option to execute unit tests only at night (#26669) ... * Add the option to execute unit tests only at night * set ut nightly label for 3 cases.	6 years ago
Aurelius84	f05613683f	[Dy2stat] Support InputSpec and Return callable class instance in @declarative (#25960) ... * add InputSpec * add unittest for tensorSpec and SimpleNet	6 years ago
YUNSHEN XIE	a8b5741fb4	add a few unittests for setting timeout properity (#26630)	6 years ago
cc	0d71cffd65	Add mnist test for post training quantization, test=develop (#26436) ... * Add mnist test for post training quantization, test=develop	6 years ago
YUNSHEN XIE	39fe0d35aa	find timeout unittests (#26371) ... * find timeout unittests * setting timeout value * fix some error * fix some error * fix some error * fix no newline of end file error	6 years ago
Pei Yang	379222c3f1	add output scale and trt op teller support for hard_swish and hard_sigmoid (#26499)	6 years ago
cc	3f816bc8b4	[Quantization] Conv2d_transpose and mul support channnelwise quantization (#25639) ... * Conv2d_transpose and mul support channnelwise quantization, test=develop * Skip collecting out threshold for output tensor of which the type is not fp32 or fp64, test=develop * Fix error in test_user_defined_quantization, test=develop * Add depthwise_conv_bn_fuse, test=develop * Add conv_transpose_bn_fuse_pass for post_training_quant, test=develop	6 years ago
Zhou Wei	5017aa76e6	set default python3,fix incompatible,cache dir for third party,unify error code,for windows (#26178) ... * set default python3 for paddle windows,test=win * set default python3,cache dir for third party,error code,test=win * fix some incompatible * fix some error * set virtual environment,test=win	6 years ago