242 Commits (5d039f40866ea2d879483668c685c5f18c4fc37d)

Author	SHA1	Message	Date
JZ-LIANG	5d039f4086	modified the implement of Lars optimizer (#26733) ... add lars to fleet meta optimizer	5 years ago
Chen Weihang	9cb57f94c6	Update set_dict method name & add aliases (#26700) ... * update set_dict method name & add aliases * fix var name error * fix alias formats * use set_state_dict in unittest * add decorator solve compatible problem * polish decorator * replace layer set_state_dict by patched method * remove import monkey path layer * fix import function error * add unittest for coverage	5 years ago
Yang Zhang	6129b0e246	Revert `no_grad` changes and add new implementation (#26826)	5 years ago
Zhou Wei	407de03905	[2.0API] Reconstruct all API related to LR Scheduler, unify dygraph and static (#26550) ... * Reconstruct all API related to lr scheduler, unify dygraph and static * Reconstruct all API related to lr scheduler, unify dygraph and static * fix doc * fix doc * fix doc of lr_scheduler * fix unittest and english doc * fix english doc * fix confilt * fix doc	5 years ago
MRXLT	eeda90d674	[WIP] update optimizer for 2.0 (#26288) ... refine Optimizer/Adam/Admax/RMSProp && add Admw * buf fix * update comment * unify arguments place; notest * fix ut, test=develop * bug fix * fix conflicts, test=develop * add examples code * bug fix * fix comments * fix sample code * add sample code for Optimizer * add adamax ut, test=develop * fix rmsprop ut, test=develop * add ut for optimizer.py and adamw.py * remove TestAdamOptimizerBetaVariable * update api && add ut * update doc && fix ut * add ut Co-authored-by: mapingshuo <mps2012@yeah.net>	5 years ago
mapingshuo	7ae10900fa	fix slow var initialize, test=develop (#26516)	5 years ago
Dong Daxiang	cbf8ba1591	add check approval (#26284) ... test=develop	5 years ago
Yang Zhang	617eb67f29	Upgrade `no_grad` decorator (#25472) ... * Upgrade `no_grad` decorator test=develop - match torch decorator usage (i.e., with parenthesis) - handle generator functions - add `paddle.no_grad` alias * Switch from `functools` to `decorator` preserves signature * Reword decorator usage note	5 years ago
WangXi	2c9d0f3cb9	【paddle.fleet】Add dgc to fleet meta optimizer (#25738) ... Add dgc to fleet meta optimizer, rm dgc from optimizer all	5 years ago
lilong12	8a68d2c213	Revert "add device attr for regularizer, test=develop (#24981)" (#25375) ... This reverts commit ab5a1fb853.	5 years ago
mapingshuo	c70f592002	add gradient Merge optimizer to meta (#25763) ... * add gradient Merge optimizer to meta, test=develop	5 years ago
tangwei12	caa90a6510	Integrated Trainer of Parameter Server (API add `fluid.contrib.layers.sparse_embedding` only) (#22957) ... * Integrated Trainer of Parameter Server	5 years ago
mapingshuo	3e2a348886	add string variable support for RecomputeOptimizer (#25728)	5 years ago
mapingshuo	ed72406558	add gradient Merge Optimizer (#25625)	5 years ago
mapingshuo	ea60e64470	correct the LookaheadOptimizer programDesc, test=develop (#25688)	5 years ago
leesusu	856e6d3348	Correct parameter l2 passed to ftrl op (#25223)	5 years ago
Zhou Wei	914ff10a8f	fix state dict to save/load learning rate scheduler (#25403) ... * fix optimizer.state_dict and LRScheduler.state_dict to save/load dygraph,test=develop * fix optimizer.state_dict and LRScheduler.state_dict to save/load dygraph,test=develop * Add a judgment that state_dict/set_dict is used incorrectly,test=develop * fix some doc error,test=develop * fix current_step_lr for _LearningRateEpochDecay,test=develop * remove some unsed code to improve coverage,test=develop * remove some unsed code to improve coverage,test=develop	5 years ago
hong	fed0588571	Fix parameter list iterator bug (#25089) ... * fix optimizer parameter is a iterator; test=develop * fix parameter list None bug; test=develop * use is not None; test=develop * change list to iterable; test=develop	5 years ago
lilong12	e39aa70ec7	add the support for pipeline (#24560) ... * add device_worker for pipeline, test=develop	5 years ago
lilong12	3d96601b82	modify pipeline optimizer to only support the mode of sync pipeline training (#25065) ... * modify pipeline optimizer, test=develop	5 years ago
Zhou Wei	c505c4dbea	add new API: optimizer.set_lr (#24455) ... * add new api: optimizer.set_lr, test=develop * add API doc and example code for optimizer.set_lr,test=develop * add API doc and example code for optimizer.set_lr,test=develop * Modified doc to :api_attr: imperative,test=develop	5 years ago
lilong12	ab5a1fb853	add device attr for regularizer, test=develop (#24981)	5 years ago
Zhou Wei	98da8a295d	add new learing rate strategy to reduce lr when loss reach on plateau (#24322) ... 添加loss自适应的学习率衰减策略。	5 years ago
swtkiwi	f5c6dd6def	test=develop (#24522)	5 years ago
hong	04e9d721a2	unitize name in optimizer; test=develop (#24008)	5 years ago
Zhou Wei	8002b2beb4	Avoid logging.info be printed many times in dygraph_mode,test=develop (#23932)	5 years ago
Zhou Wei	66dc8e30f0	move the initialize position of grad_clip to optimizer(__init__),and speed up clip (#23782)	5 years ago
mapingshuo	f0e743f136	fix AMP and recompute (#23551) ... * allow amp and recompute working together	5 years ago
Zhou Wei	629b6c7896	add the prompt message of repeated settings of regularization,test=develop (#23355)	5 years ago
qingqing01	6162cf2f2e	Make optimizer consistent in dygraph and static-graph and remove some LOG-INFO. (#23426) ... * Make optimizer consistent in dygraph and static-graph and remove some LOG-INFO	5 years ago
Zhou Wei	e8efaee92d	update gradient clip english doc for new gradient clipping strategy ... 梯度裁剪的策略进行了升级，配合修复相应的 裁剪API、minimize、ParamAttr 的API英文文档。 对应API变动的文档： #23224 对应中文文档PR：PaddlePaddle/FluidDoc#1942	5 years ago
Leo Chen	a62599a888	[feature] prune program by feed and fetch_list automatically (#22474) ... * prune train program by fetch_list, test=develop * add unittest for prune, test=develop * fix pruned feed, test=develop * support ParallelExecutor and feed prune, test=develop * add comments, test=develop * update unittest, test=develop * update unittests, test=develop * remove debug code, test=develop * support cond in clone, test=develop * support cond in prune, test=develop * support multiple minimize, test=develop * support cache, test=develop * fix _copy_param_info_from, test=develop * support python2 str, test=develop * remove debug code, test=develop * fix bug of caching CompiledProgram, test=develop * fix multi_device issue, test=develop * tmp * support tuple in fetch_list and overriding use_prune, test=develop * dont use nonlocal in python2, test=develop * remove nonlocal, test=develop * code clean, test=develop * code clean, test=develop * feed list, test=develop * test adam, test=develop * follow comments, test=develop * reduce duplicate code, test=develop * update comments, test=develop	5 years ago
Zhou Wei	7fda333ac1	add new method of gradient_clip, better to use,test=develop (#23224)	5 years ago
Leo Chen	488b2387e2	Feature/expand params in auto-generated pybind functions for dygraph operators (#23181) ... * expand parameters, test=develop * support resnet, test=develop * fix resnet, test=develop * support duplicable out, test=develop * support ptb * fix bugs, test=develop * support null input, test=develop * fix bugs, test=develop * fix batchNorm is_test, test=develop * refine code, test=develop * follow comments, test=develop * follow comments, test=develop * follow comments, test=develop * follow comments, test=develop	5 years ago
Zhang Ting	eec10aaba2	set op_device for loss_op_desc (#23027)	6 years ago
WangXi	f2265d9ffd	Fix problem use recompute and dgc same time (#23010)	6 years ago
mapingshuo	08a772cb46	fix API param bug of recompute.backward() (#22582) ... * fix API param bug of recompute.backward(), test=develop	6 years ago
WangXi	62fd3209e1	Fix dgc param regularizer, test=develop (#22888)	6 years ago
Zhang Ting	4e8bc02461	add fluid.device_guard to specify the device type for Op (#22254) ... * add fluid.device_guard to specify the device type for Op	6 years ago
tianshuo78520a	433cef03e5	fix typo word (#22784)	6 years ago
zhaoyuchen2018	72dde4abde	Refine adam op to improve performance, test=develop (#22346) ... * Refine adam op, test=develop * Fuse kernels together to reduce cpu time. * Refine paddle enforce, test=develop * Remove some comments, test=develop * Refine code,test=develop * Refine cuda kernel, test=develop * Refine code according to comments, test=develop	6 years ago
tianshuo78520a	d2ba91aad1	fix typo words (#22653)	6 years ago
WangXi	d69df9bf26	Add wrong info when use DGC in cpu (#22515)	6 years ago
Aurelius84	50af6b5d79	polish no_grad_set of gradient and append_backward (#22440) ... * polish backward api doc test=develop, test=document_preview, test=document_fix * polish backward api doc test=develop, test=document_preview, test=document_fix * no_grad supports set of Variable test=develop, test=document_preview * polish sample code of append_backward test=develop, test=document_preview * modify assert into Raise TypeError test=develop,test=document_preview * fix unittest failed test=develop * rm useless file test=develop * polish en doc test=develop * polish code of no_grad_set test=develop * polish code of no_grad_set test=develop	6 years ago
hong	00c0139e6e	add learning rate api of optimizer (#22080) ... * add learning rate api; test=develop * fix uni test converage; test=develop * fix travis ci error; test=develop * fix comment; test=develop * fix example error; test=develop * polish the api description, test=develop Co-authored-by: zhongpu <2013000149@qq.com>	6 years ago
zhongpu	b1c081f4c7	polish Optimizer's API description, test=develop (#22314)	6 years ago
Aurelius84	60a6d68fb9	remove _optimized_guard in dygrahpe_mode (#22143) ... * remove _optimized_guard in dygrahpe_mode test=develop * remove comment code test=develop * remove list append test=develop * remove list append test=develop	6 years ago
Leo Chen	d4bdbf8cf0	Polish nn code, test=develop (#22237) ... * refine code, test=develop * reuse contain_var, test=develop	6 years ago
zhongpu	d0f0a2520c	test Optimizer in dygraph (#21949) ... * test Optimizer in dygraph, test=develop * add optest for Optimizer in dygraph, test=develop * fix adagrad optimizer, test=develop * fix dpsgd optimizer, test=develop * fix test_optimizer.py, test=develop * fix dpsgd optimizer, this op only support cpu, test=develop * add optest for optimizer, test=develop * add description for dpsgd, test=develop * add rmsprop to white_list in unused_var_check.cc, test=develop * polish code style, test=develop * polish code style, test=develop * delete seed attribute for DpsgdOptimizer, test=develop * change testing to debugging, test=develop	6 years ago
zhongpu	7d10edc5ee	add clear_gradients for Optimizer and add clear_gradients api description (#21948) ... * add clear_gradients for Optimizer, add api description, test=develop * fix optest for optimizer's clear_gradient interface, test=develop * add sample code, test=develop * polish sample code, test=develop	6 years ago