101 Commits (1f89249a957b1904bd7b9770de815a311fa30bc5)

Author	SHA1	Message	Date
phlrain	77a08750e9	add var name in optimizer; test=develop	6 years ago
Qiyang Min	1f4aa7a202	Imperative remove all descs (#16045) ... * Remove Desc in Forward Pass * Refactor VarBase * Add dbg info * Only check type in imperative mode * Polish code and support optimizer test=develop * Fix stop gradient problem in PyLayer test=develop	6 years ago
Jiabin Yang	654825cfe3	test=develop, reconstruct layer helper to fit imperative usage (#15938) ... * test=develop, reconstruct layer helper to fit imperative usage * test=develop, fix import error on py35 * test=develop, fix rnn gradient error * test=develop, delete test use code * test=develop, remove helper from imperative usage * test=develop, fix test_base_layer using new helper * test=develop, reconstruct layerhelper for imperative mode * test=develop, reconstruct layerhelper for imperative mode * test=develop, fix bug * test=develop, fix test failed bug * test=develop, fix test failed bug * test=develop, fix test failed bug * test=develop, fix bug * test=develop, polish code	6 years ago
xuezhong	46fcadec18	add parameter description ... test=develop	6 years ago
xuezhong	57294fa890	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into fix_bug_adagrad ... test=develop	6 years ago
xuezhong	794b90c93f	for backward compatibility	6 years ago
minqiyang	700495e11f	Fix FtrlOptimizer's API comment ... test=develop	6 years ago
sneaxiy	7e399b0628	rename ... test=develop	6 years ago
sneaxiy	f85245b409	test=develop	6 years ago
xuezhong	20e579ef2a	add initial_accumulator_value for adagrad ... test=develop	6 years ago
minqiyang	3ce2d295c0	Refine stop_gradient ... test=develop	6 years ago
minqiyang	c8965dc1ab	Polish code ... test=develop	6 years ago
minqiyang	8ce198b2e1	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into imperative_resnet ... test=develop	6 years ago
minqiyang	dbd4d058af	Add static implementation and fix fc layer	6 years ago
minqiyang	315b133e67	Add single GPU support to imperative	6 years ago
Qiao Longfei	a6b3bf6069	add attr min_row_size_to_use_multithread in op config test=develop	6 years ago
Qiao Longfei	8c516a24e5	remote min_row_size_to_use_multithread in adam interface test=develop	6 years ago
Qiao Longfei	9b4fe283e1	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into multithread-sparse-adam ... test=develop	6 years ago
minqiyang	d0b640dca1	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into imperative_shared_ptr ... test=develop	6 years ago
Wu Yi	fd85418329	[Feature] support mix precision training for resnet (#14899) ... * clip softmax for fp16 * updates * fuse xent support fp16 test=develop * wip * wip * add simple row reduce * wip fp16 accurate softmax * add accurate softmax kernel for fp16 test=develop * update test=develop * fix cpu build test=develop * update api.spec test=develop * follow comments test=develop * fix build test=develop * fix trt build test=develop * fix inference build test=develop * fix merge test=develop * update test=develop * try fix build test=develop * fix build test=develop * rename real_exp test=develop * fortest * remove hacky kernels test=develop * clean up test=develop	6 years ago
minqiyang	7aab39af15	Change grads to VarBase	6 years ago
Qiao Longfei	44b300556d	change min_row_size_to_use_multithread to parameter of adam ... test=develop	6 years ago
minqiyang	336160e651	Complete imperative optimizer implementation ... test=develop	6 years ago
minqiyang	28013a5048	Polish code ... test=develop	6 years ago
minqiyang	5822f7f1d8	Polish code ... test=develop	6 years ago
minqiyang	fff44af83f	Support simple optimizer ... test=develop	6 years ago
minqiyang	68e9b841ab	Add support for optimizer	6 years ago
typhoonzero	da87f7a698	Revert "[Feature] Fp16 training for resnet50 (#14850)" ... This reverts commit 3d750f9c5a.	6 years ago
Wu Yi	3d750f9c5a	[Feature] Fp16 training for resnet50 (#14850) ... * wip * wip * wip * wip for test * add fp16 tests test=develop * fix cpu build test=develop * fix test=develop * fix py3 tests test=develop * fix lr_scheduler dtype test=develop * fix test=dvelop * test fix ci compile test=develop * fix build and merge test=develop * fallback momentumop change to general test=develop	6 years ago
Qiao Longfei	eb5d427d39	add comment for lazy_mode adam optimizer	6 years ago
Qiao Longfei	c624417c6f	change sparse mode to lazy mode	6 years ago
Qiao Longfei	fc6ec6bd14	add sparse mode adam	6 years ago
Qiao Longfei	d03cbd1b8c	follow comment test=develop	6 years ago
Qiao Longfei	373f64986d	add comment and unit test ... test=develop	6 years ago
Qiao Longfei	55edfca2b8	revert unused change	6 years ago
Qiao Longfei	fec0b192a2	fix unit test ... test=develop	6 years ago
Qiao Longfei	3d8077e9fb	update optimizer	6 years ago
Qiao Longfei	fbcdb29d8c	fix import issue	6 years ago
Qiao Longfei	866d6bfe59	dist table support other optimize and regular config	6 years ago
Wu Yi	26200f2e42	[1.1] [project] train imagenet using large batch size (#13766) ... * fix nccl2 lars dist support * put lars in momentum op * add tests lars * fix ci * fix cpu kernel * soft warning * remove lars in test_recognize_digits.py * move to another op * add file * update api.spec test=develop * update test=develop * fix api.spec test=develop * wip * wip, finish grad merge ops * wip, finish graph build * wip test running * work on 1 gpu * workable version * update * fix tests * fuse broadcast op * fix compile failed * refine * add batch merge test mnist * fix CI test=develop * fix build * use independent bn params for batch merge test=develop * update api.spec * follow comments and for test * wip * refine tests test=develop * follow comments test=develop * remove startup bn modify test=develop * follow comments test=develop * fix merge test=develop	6 years ago
Xin Pan	d5d09672c8	better fix ... test=develop	6 years ago
tangwei12	e3964e5a43	lookup table bug fix about lr, test=develop (#13946)	6 years ago
chengduo	8e2fdc54b1	Add check for opt op (#13840) ... * add check for opt op * fix opt op test=develop * fix test fail test=develop * fix optimization doc test=develop * test=develop	6 years ago
sneaxiy	0633095c74	fix_api_kwargs	6 years ago
Xin Pan	88ae3f169d	further clean	6 years ago
Xin Pan	2030958eee	covert **kwargs to explicit arguments ... Also deprecate LARs argument	7 years ago
Wu Yi	efafc72f62	Hide program APIs (#12315) ... * hide program APIs * fix merge error * update	7 years ago
Qiao Longfei	6e03f7900f	Add centered mode rmsprop (#13161) ... * rmsprop optimizer support v1 mode * typo * optimize code * refine code * optimize unit test * update test_rmsprop_op.py * update formula of rmsprop * optimize document * update API.spec for RMSPropOptimizer * add default value to check_output_with_place equal_nan	7 years ago
Xin Pan	51ef0ad766	allow to use name_scope for debugging and visiualization	7 years ago
whs	9be39bb4b7	Enhence optimizer. (#13004)	7 years ago