259 Commits (16ba0abc79c6d6f5c642d99638ee0f77d8a45a1e)

Author	SHA1	Message	Date
JZ-LIANG	16ba0abc79	Recompute Offload: fixed bug in memcpy (#30484)	5 years ago
guofei	11e78ebaa3	Modify the calculation logic of LambOptimizer (#29313) ... * Modify the calculation logic of LambOptimizer	5 years ago
JZ-LIANG	75936d838f	Recompute Offload (#30233)	5 years ago
WangXi	ee16006b5d	Optimization grad merge performance (#29784)	5 years ago
Leo Chen	a4b9daf97c	fix optimizer dtype (#29917)	5 years ago
lilong12	01950ceb42	fix the bug in pipeline data parallelism (#29731) ... * update, test=develop	5 years ago
Aurelius84	5d530c9319	fix amp support fleet (#29491)	5 years ago
Zhou Wei	c0a991c874	accumulate gradient for leaf tensor with previous graph and expose leaf tensor concept (#28429) ... * The leaf tensor concept is exposed and the gradient accumulation of leaf tensor * The leaf tensor concept is exposed and the gradient accumulation of leaf tensor * fix coverage * fix api doc * fix CI unittest * fix CI unittest * fix unitest * empty tensor does’t need inner_var_ * fix some error message	5 years ago
ShenLiang	e2d01eb650	Support dynamic graph distributed (#28997) ... * add reducer * refine envent for memorycopy * add concat&split for allreduce * apply concat & split for fuse tensor * fix nccl dep * fix the untest, compile problem and ddp initialize problem * fix untest for mac & add some comments & solve the repeated param in sublayers * fix untest for windows & fix document	5 years ago
Leo Chen	3815d7aa40	Upgrade string literals to raw string (#28989) ... * upgrade comment string to raw string * fix string in * fix string with ' ' * revert update on comments * upgrade only necessary * fix sample code checker * fix comments with '''	5 years ago
lilong12	f77a78cdee	enable pipeline to run with Executor.run() (#28373) ... * update, test=develop	5 years ago
Zhou Wei	e122e16456	fix english doc, unittest, and remove useless alias of 2.0 lr_scheduler (#27686) ... * fix doc and unittest of 2.0 lr_scheduler * fix doc of 2.0 lr_scheduler * fix unittest * fix english doc of lr_scheduler * fix api name of lr scheduler * fix api name of lr scheduler	5 years ago
WangXi	0a1862d1d2	fleet combine amp dgc recompute meta optimizer (#27643)	5 years ago
123malin	54c368db1e	[API 2.0: doc] fix doc of nonzero (#27685) ... * test=develop, update example	5 years ago
Chen Weihang	dec53a9c79	Remove DataParallel.scale_loss & apply_collective_grads (#27603) ... * remove data parallel scale loss & apply collective_grads * move apply in minimize * fix failed unittests	5 years ago
Chen Weihang	bb84f0e646	Add new paddle.save/load APIs (#27331) ... * init commit of new save/load * fix failed unittests * fix save_load_v2 unittest failed * fix failed unittest & polish doc * add tests for coverage * add more tests & move static apis * fix example code error * polish emample code * fix detail example code problem	5 years ago
Yibing Liu	34091533c9	Fix bug in continuous apply, test=develop (#27337)	5 years ago
JZ-LIANG	5d039f4086	modified the implement of Lars optimizer (#26733) ... add lars to fleet meta optimizer	5 years ago
Chen Weihang	9cb57f94c6	Update set_dict method name & add aliases (#26700) ... * update set_dict method name & add aliases * fix var name error * fix alias formats * use set_state_dict in unittest * add decorator solve compatible problem * polish decorator * replace layer set_state_dict by patched method * remove import monkey path layer * fix import function error * add unittest for coverage	5 years ago
Yang Zhang	6129b0e246	Revert `no_grad` changes and add new implementation (#26826)	5 years ago
Zhou Wei	407de03905	[2.0API] Reconstruct all API related to LR Scheduler, unify dygraph and static (#26550) ... * Reconstruct all API related to lr scheduler, unify dygraph and static * Reconstruct all API related to lr scheduler, unify dygraph and static * fix doc * fix doc * fix doc of lr_scheduler * fix unittest and english doc * fix english doc * fix confilt * fix doc	5 years ago
MRXLT	eeda90d674	[WIP] update optimizer for 2.0 (#26288) ... refine Optimizer/Adam/Admax/RMSProp && add Admw * buf fix * update comment * unify arguments place; notest * fix ut, test=develop * bug fix * fix conflicts, test=develop * add examples code * bug fix * fix comments * fix sample code * add sample code for Optimizer * add adamax ut, test=develop * fix rmsprop ut, test=develop * add ut for optimizer.py and adamw.py * remove TestAdamOptimizerBetaVariable * update api && add ut * update doc && fix ut * add ut Co-authored-by: mapingshuo <mps2012@yeah.net>	5 years ago
mapingshuo	7ae10900fa	fix slow var initialize, test=develop (#26516)	5 years ago
Dong Daxiang	cbf8ba1591	add check approval (#26284) ... test=develop	5 years ago
Yang Zhang	617eb67f29	Upgrade `no_grad` decorator (#25472) ... * Upgrade `no_grad` decorator test=develop - match torch decorator usage (i.e., with parenthesis) - handle generator functions - add `paddle.no_grad` alias * Switch from `functools` to `decorator` preserves signature * Reword decorator usage note	5 years ago
WangXi	2c9d0f3cb9	【paddle.fleet】Add dgc to fleet meta optimizer (#25738) ... Add dgc to fleet meta optimizer, rm dgc from optimizer all	5 years ago
lilong12	8a68d2c213	Revert "add device attr for regularizer, test=develop (#24981)" (#25375) ... This reverts commit ab5a1fb853.	5 years ago
mapingshuo	c70f592002	add gradient Merge optimizer to meta (#25763) ... * add gradient Merge optimizer to meta, test=develop	5 years ago
tangwei12	caa90a6510	Integrated Trainer of Parameter Server (API add `fluid.contrib.layers.sparse_embedding` only) (#22957) ... * Integrated Trainer of Parameter Server	5 years ago
mapingshuo	3e2a348886	add string variable support for RecomputeOptimizer (#25728)	5 years ago
mapingshuo	ed72406558	add gradient Merge Optimizer (#25625)	5 years ago
mapingshuo	ea60e64470	correct the LookaheadOptimizer programDesc, test=develop (#25688)	5 years ago
leesusu	856e6d3348	Correct parameter l2 passed to ftrl op (#25223)	5 years ago
Zhou Wei	914ff10a8f	fix state dict to save/load learning rate scheduler (#25403) ... * fix optimizer.state_dict and LRScheduler.state_dict to save/load dygraph,test=develop * fix optimizer.state_dict and LRScheduler.state_dict to save/load dygraph,test=develop * Add a judgment that state_dict/set_dict is used incorrectly,test=develop * fix some doc error,test=develop * fix current_step_lr for _LearningRateEpochDecay,test=develop * remove some unsed code to improve coverage,test=develop * remove some unsed code to improve coverage,test=develop	5 years ago
hong	fed0588571	Fix parameter list iterator bug (#25089) ... * fix optimizer parameter is a iterator; test=develop * fix parameter list None bug; test=develop * use is not None; test=develop * change list to iterable; test=develop	5 years ago
lilong12	e39aa70ec7	add the support for pipeline (#24560) ... * add device_worker for pipeline, test=develop	5 years ago
lilong12	3d96601b82	modify pipeline optimizer to only support the mode of sync pipeline training (#25065) ... * modify pipeline optimizer, test=develop	5 years ago
Zhou Wei	c505c4dbea	add new API: optimizer.set_lr (#24455) ... * add new api: optimizer.set_lr, test=develop * add API doc and example code for optimizer.set_lr,test=develop * add API doc and example code for optimizer.set_lr,test=develop * Modified doc to :api_attr: imperative,test=develop	5 years ago
lilong12	ab5a1fb853	add device attr for regularizer, test=develop (#24981)	5 years ago
Zhou Wei	98da8a295d	add new learing rate strategy to reduce lr when loss reach on plateau (#24322) ... 添加loss自适应的学习率衰减策略。	5 years ago
swtkiwi	f5c6dd6def	test=develop (#24522)	6 years ago
hong	04e9d721a2	unitize name in optimizer; test=develop (#24008)	6 years ago
Zhou Wei	8002b2beb4	Avoid logging.info be printed many times in dygraph_mode,test=develop (#23932)	6 years ago
Zhou Wei	66dc8e30f0	move the initialize position of grad_clip to optimizer(__init__),and speed up clip (#23782)	6 years ago
mapingshuo	f0e743f136	fix AMP and recompute (#23551) ... * allow amp and recompute working together	6 years ago
Zhou Wei	629b6c7896	add the prompt message of repeated settings of regularization,test=develop (#23355)	6 years ago
qingqing01	6162cf2f2e	Make optimizer consistent in dygraph and static-graph and remove some LOG-INFO. (#23426) ... * Make optimizer consistent in dygraph and static-graph and remove some LOG-INFO	6 years ago
Zhou Wei	e8efaee92d	update gradient clip english doc for new gradient clipping strategy ... 梯度裁剪的策略进行了升级，配合修复相应的 裁剪API、minimize、ParamAttr 的API英文文档。 对应API变动的文档： #23224 对应中文文档PR：PaddlePaddle/FluidDoc#1942	6 years ago
Leo Chen	a62599a888	[feature] prune program by feed and fetch_list automatically (#22474) ... * prune train program by fetch_list, test=develop * add unittest for prune, test=develop * fix pruned feed, test=develop * support ParallelExecutor and feed prune, test=develop * add comments, test=develop * update unittest, test=develop * update unittests, test=develop * remove debug code, test=develop * support cond in clone, test=develop * support cond in prune, test=develop * support multiple minimize, test=develop * support cache, test=develop * fix _copy_param_info_from, test=develop * support python2 str, test=develop * remove debug code, test=develop * fix bug of caching CompiledProgram, test=develop * fix multi_device issue, test=develop * tmp * support tuple in fetch_list and overriding use_prune, test=develop * dont use nonlocal in python2, test=develop * remove nonlocal, test=develop * code clean, test=develop * code clean, test=develop * feed list, test=develop * test adam, test=develop * follow comments, test=develop * reduce duplicate code, test=develop * update comments, test=develop	6 years ago
Zhou Wei	7fda333ac1	add new method of gradient_clip, better to use,test=develop (#23224)	6 years ago