Paddle

Commit Graph

Author	SHA1	Message	Date
Zhen Wang	71acde9afc	Use correct master weights in AdamW. (#30895 ) * Use correct master weights in AdamW. * Just modify the master weight. * Update for CI Coverage.	5 years ago
Zhen Wang	7f7dfccf20	Support pure fp16 training for AMP API. (#29544 ) * add cast ops before and after unsupported fp16 ops. * Keep partial net in FP32 pattern. * Support check_finite_and_unscale and update_loss_scaling for FP16 calculation mode. * Add fp16 support for adam op. * add multi precision attr for adam. * Fix the bug of test_multi_precision_fp16_train UT. * Code format for CI. * Fix the redefine error about MPTypeTrait on windows. * fix bugs of the _create_accumulators func in Momentum. * fix bug when inserting post cast op. * Add the update_loss_scaling op in allow_set of UnusedVarCheck. * Update for ci coverage. * Add some doc for OptimizerWithMixedPrecision. * Fix the code style. * Imporve the doc of `amp_init`. * Change for fp16 testing if users have the infer program defined in separate way.	5 years ago
huangxu96	a29006d128	Optimizer trans momentum (#29597 ) * merge amp related function in Momentum from paddle.fluid.contrib.optimizer into paddle.optimizer. * Add unittest for 2.0 Momentum API. * fix some bugs in weight_decay.	5 years ago
huangxu96	97e29411eb	fix a bug in multi_precision_fp16 unittest. (#29756 )	5 years ago
huangxu96	b96dada4f0	add static.amp into setup.pu.in (#29621 ) * add static.amp into setup.pu.in * add unittest for api	5 years ago
Zhen Wang	be3777a50a	Add pure fp16 training with master weights. (#27712 ) * add the weight decay func for the momentum op * Add the multi_precision function in Momentum Optimizer. * Make sure that the initial value of master weights are same with the fp16 weights. * add static loss scaling. * add the rescale_grad function in the pure fp16 training. * use the original momentum updating method. * Polish some codes, such as variable names. * add docstring for apis. * update the var creation details of _create_master_weight. * not modify codes about imperative momentum updating. * Fix the error of test_dist_sparse_tensor_load_momentum UT. * add unit test for multi precision fp16 training. * add more unit tests for CI. * Use lower threshold values for allclose comparing in test_multi_precision_fp16_train UT. * For CI Coverage Checking.	5 years ago
Chen Weihang	358d6bc90f	Fix test_weight_decay_extend random failed on windows (#28643 ) * add debuging code * change seed & add debug message	5 years ago
YUNSHEN XIE	ba0756325a	exec ut no more than 15s 1 (#28439 ) * disable ut test_parallel_executor_fetch_isolated_var,test=document_fix * test for limiting ut exec time as 15S * fix an error caused by cannot find ut * fix some error * can not find test_transformer * fix error caused by ut not run in windows * fix error caused by Compiler Options * fix error caused by setting timeout value as 15 in python/paddle/tests/CMakeLists.txt * setting timeout value to 120s for old ut * add the timeout value setting * fix error caused by ut only run in coverage_ci * add analyzer_transformer_profile_tester * fix some error * fix some error * fix error with inference option * fix error with inference option setting as ON_INFER * add some ut to set timeout * modified some option * fix error * fix some timeout error * fix error * fix error * fix timeout for test_analyzer_bfloat16_resnet50 * fix error * setting timeout properity for some ut * first pr for new ut timeout as 15S	5 years ago
Leo Chen	71d6220772	Skip reader op in mixed_precision decorator (#28353 ) * skip reader op in mixed_precision decorator * add ut	5 years ago
Chen Weihang	5d73bfdb98	fix test_weight_decay_extend error (#28178 )	6 years ago
cnn	7c1aa0d69d	2.0rc api rename (#28088 ) * rename manual_seed to seed * rename xxx1d-->xxx1D, xxx2d-->xxx2D, xxx3d-->xxx3D * rename manual_seed --> seed * do not rename .cc, .cu and .h file * rename manual_seed --> seed * rename manual_seed --> seed * rename manual_seed --> seed * rename manual_seed --> seed * disable_static on doc example code * donot change manual_seed on generator * add enable_static on sample code * convert python/paddle/fluid/layers/nn.py to bak * fix typo * fix code style * fix seed to manual_seed when call functions of Generator() * fix bug	6 years ago
Chen Weihang	f2c97b6da5	replace dataset with fake data (#27519 )	6 years ago
pangyoki	827ac36faa	Use dygraph mode by default (#27443 ) * default open dygraph mode * fix CI-Mac * fix Mac-CI other unittest file * fix CI-Py3 * fix test_communicator_geo and test_buffer_shared_memory_reuse_pass * add enable_static to fix CI-Py3 * add enable_static to fix CI-coverage * delete try except	6 years ago
LielinJiang	8df5b4d608	Add correlation api to contrib (#27015 ) * add correlation api to contrib	6 years ago
Leo Chen	844583c8fd	Refine paddle.manual_seed (#26496 ) * refine manual seed * fix ci problem * fix unittests * fix unittest * set is_init_py=false in manual_seed * fix unittest * fix bernoulli_op * fix(unittest): change random_seed to manual_seed * 🐞fix(unittest): fix manual_seed * trigger ci * fix test_sentiment * fix test_imperative_save_load * fix test_uniform_random_op * fix test_uniform_random_op * fix test_jit_save_load * merge develop * fix manual_seed * fix manual_seed * use global engine * use shared_ptr * fix double free * fix bug * fix bug * fix bug * fix test bug * fix test bug * fix test bug * fix ci	6 years ago
Zhou Wei	5017aa76e6	set default python3,fix incompatible,cache dir for third party,unify error code,for windows (#26178 ) * set default python3 for paddle windows,test=win * set default python3,cache dir for third party,error code,test=win * fix some incompatible * fix some error * set virtual environment,test=win	6 years ago
mapingshuo	f0e743f136	fix AMP and recompute (#23551 ) * allow amp and recompute working together	6 years ago
tianshuo78520a	433cef03e5	fix typo word (#22784 )	6 years ago
gongweibao	3255fe69bb	Add custom black variable name set in amp interface. (#20875 ) * add custom black varname test=develop * fix dtype test=develop * fix num test=develop * fix ut test=develop * fix coverage test=develop * fix blackvar names test=develop	7 years ago
gongweibao	1d82025e89	Add interface so user can get scaled loss when they use customized loss. (#20571 )	7 years ago
Jie Fang	d9db94d752	Optimize amp for multi-gpu to enable FP16 gradients transfer across gpus. (#19714 ) Optimize amp for multi-gpu to enable FP16 gradients transfer across gpus	7 years ago
gongweibao	6c2bc29cc0	Fix float16 optimizer. (#19682 ) Fix float16 optimizer	7 years ago
Jie Fang	c6a598a276	init new amp, optimize inserting cast op for batchnorm (#18596 ) init new amp, optimize inserting cast op for batchnorm	7 years ago
Tao Luo	2f8c7e021f	remove unused inference_transpiler unit-tests (#19130 ) * remove unused inference_transpiler unit-tests test=develop * remove InferenceTranspiler usage in quantize_transpiler.py test=develop	7 years ago
翟飞跃	19da59ed3f	Remove all the code, API and doc of MKL-DNN INT8v1 (#18347 )	7 years ago
chengduo	5588b923f3	Add multi process reader (#18115 ) * add multi process reader test=develop	7 years ago
Huihuang Zheng	0bf2535158	Cherry-pick: fix random CI failure. (#18011 ) * Cherry-pick fix random Python3 CI failure. In some tests, SWEs used "print('xxx').format('xxx')". The syntax is only supported in Python2, not python3. However, since those lines are related to data download, if the CI machines already have the data, it passes CI tests. That causes random failure. * Cherry-pick: disable CUDNN case of test_warpctc_op Also temporary disable a unit test. The test will be fixed under high priority.	7 years ago
chengduo	9322216170	Add data distributed_sampler (#17573 ) * add data parallel batch	7 years ago
Yibing Liu	f9796b1249	Add LAMB Optimizer support (#17489 ) * Add LAMB optimizer * Expose LAMB Optimizer's APIs test=develop, test=document_preview * Cleanup code & doc test=develop, test=document_preview * Update lamb optimizer's formula test=develop	7 years ago
Jie Fang	30e178fa2c	init auto loss scaling (#17194 ) * init auto loss scaling test=develop * change API.spec * change ifelse to switch and use reduce_sum to optimize checking isfinite test=develop * Remove redundant code test=develop	7 years ago
guomingz	e4a52e082f	resolve #17159 (#17172 ) Update the folder name generation mechanism for saving the quantized model and weights. The folder name would be unique by adding the timestamp postfix. test=develop	7 years ago
Yibing Liu	beda78258f	Init mixed precision training interface (#16856 ) * Init mixed precision training interface * Add fp16 test script test=develop * All initializers support float16 test=develop * Code cleanup & add more code annotations test=develop * Update API spec test=develop * Add usage example in doc test=develop	7 years ago
Wang, Chuanqi	45ebafc33e	Split test_calibration test to two tests (#16977 ) * Split test_calibration test to two tests test=develop * Modify CMakeLists file test=develop	7 years ago
Tao Luo	bc037c13c7	use multi-thread to speedup CI tests test=develop	7 years ago
chuanqiw	1818d1d9f0	Reduce test_calibration test time by using large batchsize test=develop	7 years ago
chengduo	bb80dae7d0	Add DecoupledWeightDecay (#16427 ) * Add DecoupledWeightDecay	7 years ago
liuwei1031	de3b70a101	fix cdn issue, test=develop (#16423 ) * fix cdn issue, test=develop * fix cdn issue, test=develop	7 years ago
chuanqiw	431068c9ca	Enhance test calibration script on accuracy assert test=develop	7 years ago
Zhang, Guoming	e5d3d7c63d	resolve #15724 1.Remove the code for setting mkldnn environment in the test_calibration.py; 2.Update the cmake file for MKLDNN environment enabling; 3.Update the INT8 inference doc. test=develop	7 years ago
WangZhen	28dfad5e27	fix some bugs about python3. test=develop	7 years ago
WangZhen	2175292634	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into quantization_inference_passes test=develop	7 years ago
Haihao Shen	1b8047b712	Add INT8 calibration support in Paddle package (#15569 ) * Add INT8 calibration support in Paddle package; test=develop	7 years ago
Haihao Shen	294d594450	Enable performance measurement in INT8 calibration unit test (#15560 ) * Enable performance measurement in INT8 calibration unit test	7 years ago
WangZhen	c67b29c178	fix some bugs of graph.to_program and get_pass.	7 years ago
Haihao Shen	f82515800c	Enable INT8 Calibration Unit Test for MobileNet-V1 (#15539 ) * Enable mobilenet UT in separate test class; use download cache by paddle download utility and cache unzip; and fix typo; test=develop * Extract cache_unzipping function for reuse; format code style; test=develop * Simplify the test code by define a combined function for both downloading and unzipping; test=develop	7 years ago
WangZhen	c64f22048a	add convert_to_int8 pass and transform_for_mobile pass and their UTs.	7 years ago
Haihao Shen	2a82c5651e	Refine INT8 calibration API; shorten the iteration number to reduce test time; test=develop	7 years ago
guomingz	dbdaf15ca0	[V1.3] Add the calibration tool code for int8 inference and focus test. (#15062 ) * Add the calibration tool code for int8 inference and focus test. * Fix the calibration tool per the review comments. test=develop * Update the calibrator doc and remove extra line. * Fix the invalid is_negative_input attr set on Mobilenet. * Add the comments and fix the format issue. test=develop * Update the CMakelist.txt for Calibration PR.Disable the Calibration UT if not enable MKLDNN. test=develop * Update the CMakeList.txt. test=develop * Disable the test_calibration case on WIN and MAC. test=develop * Add the missing brackets. test=develop * Remove the outdated map operator which not supported on Python3. test=develop * Fix the style issue. test=develop * 1.Update the CMakeList.txt to disable calibration tool ut when the WITH_MKL is not set; 2.Add the workaround to enable the FLAGS_use_mkldnn for PR_CI(PADDLE). test=develop * Fix the typo and format the License header. test=develop * 1.Add and Update TODOs per review comments. 2.Code clean. test=develop	7 years ago
Dang Qingqing	f63ab5619b	Fix conflict.	8 years ago
Dang Qingqing	8f5d918a19	Disable one test in test_quantize_transpiler.	8 years ago

1 2

60 Commits (adaec0073d02c0ea55bcabc4671ebfc8dbd3182c)