167 Commits (e2c7b6821a817ba762b7f2a25a7b844f34cdaeb9)

Author	SHA1	Message	Date
Chen Weihang	98acfe97ec	Polish English APIs' doc of several Optimizers (#20166) ... * polish minimize en doc * polish adam optimizer en doc * polish adamax optimizer en doc * polish adagrad and decayed adagrad optimizer en doc * polish model average en doc, test=develop, test=document_fix, test=document_preview * self review and further polishing doc * update API.spec, test=develop, test=document_fix * update fluid.data api in examples, test=develop, test=document_fix * update fluid.data inferface, test=develop, test=document_fix * replace -1 by none, test=document_fix	5 years ago
Zeng Jinle	02c6edc0d5	refine optimizer name doc, test=develop, test=document_fix (#20074)	5 years ago
Zeng Jinle	20f0878f70	Fix en docs of apis (#20050) ... * fix en docs of apis, test=develop, test=document_fix * follow chunwei's comments, test=develop	5 years ago
WangXi	8d92b36d51	Refine document of DGCMomentumOptimizer (#19960) ... Refine document of DGCMomentumOptimizer	5 years ago
mapingshuo	d62360fe5f	fix doc of apply_optimize (#19965) ... * fix doc of apply_optimize test=document_fix test=document_preview * modify doc of backward test=develop test=document_fix * modify document hash test=develop test=document_preview	5 years ago
Zeng Jinle	4a5ce4feb1	Add AdadeltaOptimizer doc (#19875) ... * add AdadeltaOptimizer doc, test=develop * refine doc,test=develop * folllow lanxiang's comments, test=develop, test=document_fix	5 years ago
jhjiangcs	766bd529d1	add optimizer:dpsgd,test=develop (#19915)	5 years ago
mapingshuo	9901f69677	Forward recompute3 (#19913) ... * add recompute based checkpoints methods for large batch training test=develop * add append_backward_with_forward_recomputation test=develop * refine optimizer test=develop * update backward and optimizer test=develop * make Variable usable test=develop * add recompute code * refine optimizer test=develop * refine addup _append_backward_ops_with_checkpoints_ 1) for recompute part, just cache the grad_op_desc without appending to block 2) before appending grad_op_desc to backward part, addup_repetitive_vars, remove unused branch test=develop * make method private * add recompute strategy into DistributedStrategy test=develop * checkpoint version3 test=develop * remove some print information test=develop * remove unused sumop test=develop * try to fix recompute with graph building modules * add input names to vars should be held * add memory debug tool * backup backward * Fix bugs * add backward desc for op not in any segments * add exception info for sub_block test=develop * modify code style test=develop * modify code style test=develop * remove print functions test=develop * add API spec test=develop test=document_preview * make Recompute a child class of Optimizer test=develop test=document_preview * add API spec test=develop test=document_preview * modify API spec test=develop test=document_preview * add document for Recompute test=develop test=document_preview * change API doc of Rcompute test=develop test=document_preview * code cleaning test=develop test=document_preview * modify API spec * fix bugs when segments hold no element * add testcase for Recompute Optimizer test=develop test=document_preview * add test for apply_gradient, and code cleaning test=develop test=document_preview * add test case for load function * enable CI test=develop test=document * add test case test=develop test=document_preview * add sample code for 4 function of recompute optimizer test=develop test=document_preview	5 years ago
chengduo	ae31faaa87	refine optimier function (#19886) ... test=developt	5 years ago
gongweibao	6c2bc29cc0	Fix float16 optimizer. (#19682) ... Fix float16 optimizer	6 years ago
Jiabin Yang	e9233d1c1e	Refactor dygraph (#19107) ... * refactor dygraph,test=develop * fix failed unittest,test=develop * polish code,test=develop * check windows ci error,test=develop try to fix windows ci error by np.allclose,test=develop * polish vlog and profiler, test=develop * try to fix preceding ops order,test=develop * test transformer in windows ci, test=develop * use python c-api to speed up tracer.trace,test=develop * test=develop, fix docker with paddle nccl problem * test=develop, add ut for debug string and gradient_accumulator * test=develop, add tests for layer/gradient_accumulator/prepared_op * test=develop, fix complie error for test_prepared_op * test=develop, add more ut for dygraph * test=develop, create API.spec for dygraph api change * test=develop, refoctor name to make it easier to understand * test=develop, refoctor name to make it easier to understand * test=develop, fix multi-gpu failed problem , add Tracer tests, change PADDLEENFORCE to PADDLEENFORCE_EQ * test=develop, fix ut failed on parallel se-resnext * test=develop, change one more PADDLE_ENFORCE	6 years ago
chengduo	bfb6ac816e	Fix optimizer bug (#19410) ... * fix optimizer bug test=develop	6 years ago
mapingshuo	d5ac87ec22	Lookahead optimizer (#19386) ... * Add lookahead optimizer * add unittest for lookahead optimizer test=develop * add doc string for LookaheadOptimizer test=develop test=document_preview * add API spec for lookahead test=develop test=document_preview * modify api spec test=develop test=document_preview * modified doc string * modify the test file test=develop test=document_preview * modify doc string test=develop test=document_preview	6 years ago
gongweibao	29d8781240	Polish fleet API to support cuda collective mode and nccl2 mode. (#18966) ... Polish fleet API to support cuda collective mode and nccl2 mode	6 years ago
LielinJiang	e5b9753a18	Fix ExponentialMovingAverage api bug in python3, test=develop (#18775)	6 years ago
xsrobin	47e2ef38e9	add "import paddle.fluid as fluid" to examples lack of it	6 years ago
hutuxian	8a39e5c110	update api format (#18413) ... * update api format test=develop * update API.spec test=develop	6 years ago
Yibing Liu	23941e43ec	Update lamb optimizer (#18333) ... * Update lamb optimizer test=develop, test=document_preview * Regenerate api spec test=develop, test=document_preview	6 years ago
hutuxian	6ed73830c2	add api desc for pipeline training (#18293)	6 years ago
Yibing Liu	412951d7d2	Fix ema's example & fp16 update (#18273) ... test=develop, test=document_preview	6 years ago
wopeizl	222c9fe57e	fix doc for LarsMomentumOptimizer test=develop (#18208)	6 years ago
hutuxian	969e6378b9	Pipeline Concurrency (#17402) ... Add Pipeline Concurrency Train Mode: - Cpp: pipeline_trainer & section_worker - Python: PipelineOptimizer - Add a new data_feed type: PrivateInstantDataFeed - Add a test demo of pipeline trainer and the test model is gnn - Do not support win32 now	6 years ago
Jiabin Yang	022dfed4fc	Add optimizer save and load (#16986) ... * save optimizer related vars in dygraph * test=develop, add optimizer save and load * test=develop, add optimizer save and load * test=develop, merge code and add multi-optimizer save and load * test=develop, fix test_imperative_checkpoint * test=develop, fix include error * test=develop, fix include error * test=develop, renew api spec * test=develop, refine code * test=develop, set default value for checkpoint * test=develop, fix ci error * test=develop, change API.spec and make api more readable * test=develop, refine version and time stamp * test=develop, add example code and refine code * test=develop, refine doc * test=develop, change version	6 years ago
Yibing Liu	d6d33fd748	Add update method for ema (#17812)	6 years ago
Zeng Jinle	3a6ead24ad	Add no_grad decorator to dygraph (#17790) ... * add no_grad decorator to dygraph, test=develop * add unittest,test=develop	6 years ago
lujun	ed9d603a8a	fix api doc: Optimizer.ModelAverage (#17395)	6 years ago
Hongyu Liu	9f85f21880	Add new gard clip [old gradient clip not support in dy graph] (#17523) ... * add gradient clip in minimize; test=develop * fix bug; test=develop * fix format; test=develop * move new grad clip to dygraph/grad_clip.py; test=develop * fix lr decay and grad clip test; test=develop * seperate dygraph grad clip; test=develop * fix grad clip test; develop * fix api spec bug; test=develop * add blank line, test=develop,test=document_preview to fix format problem	6 years ago
wopeizl	058f1f1e1b	fix the api example for create_global_var, create_parameter, SGDOptim… (#17371) ... * fix the api example for create_global_var, create_parameter, SGDOptimizer, RMSPropOptimizer, MomentumOptimizer, LarsMomentumOptimizer, FtrlOptimizer test=develop * add example for adamoptimizer fix API.spec test=develop * test=develop * test=develop	6 years ago
Yibing Liu	4f4f0993c1	Bias correction for exponential moving average (#17677) ... * Bias correction for exponential moving average test=develop, test=document_preview * Fix docs test=develop, test=document_preview	6 years ago
Zeng Jinle	887a39f050	Fix dygraph unique name bug (#17592) ... * fix unique_name growth bug in dygraph mode,test=develop * change generate_tmp to generate_with_ignorable_key,test=develop	6 years ago
Hongyu Liu	e53119f5b1	Fix decayed adagrad example (#17390) ... * fix DecayedAdagrad example; test=develop test=document_preview * add space; test=develop	6 years ago
Yibing Liu	6e11f97708	Add exponential moving average (#17562) ... * Add exponential moving average test=develop, test=document_preview * Polish documents test=develop, test=document_preview * Update API spec test=develop, test=document_preview	6 years ago
Qiao Longfei	58f7695ab2	Async exe support communicator (#17386) ... Async exe support communicator	6 years ago
Yibing Liu	f9796b1249	Add LAMB Optimizer support (#17489) ... * Add LAMB optimizer * Expose LAMB Optimizer's APIs test=develop, test=document_preview * Cleanup code & doc test=develop, test=document_preview * Update lamb optimizer's formula test=develop	6 years ago
Zeng Jinle	65dd7ec2d6	add clear ops in dygraph optimizers,test=develop (#17484)	6 years ago
Jiabin Yang	15453d05a8	test=develop, fix AdgradOptimizer example code (#17401)	6 years ago
chengduo	d915a04907	Add examples for AdamaxOptimizer (#17381) ... test=develop	6 years ago
gongweibao	91784f8ec3	Fix code in document. (#17237)	6 years ago
gongweibao	cbdb8a17b1	Polish DGC code (#16818)	6 years ago
minqiyang	08a7cdee11	Polish code ... test=develop	6 years ago
minqiyang	20ead9e659	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into imperative_fix_growing_dict ... test=develop	6 years ago
lujun	9bd44b94da	Merge pull request #16561 from junjun315/move-api-to-root ... Move dygraph api to root	6 years ago
gongweibao	95410652e8	Fix dgc spelling mistakes. (#16733)	6 years ago
minqiyang	9434f9a6f9	Fix auto growth bug of optimizer in dygraph mode ... test=develop	6 years ago
lujun	92c8ac8a74	merge conflict, test=develop	6 years ago
gongweibao	8b793d0efd	Fix DGC bug. (#16697)	6 years ago
lujun	01f4f2d7e4	merge confict, test=develop	6 years ago
gongweibao	0342f01249	Fix dgc bug. (#16602)	6 years ago
Qiyang Min	d8d73ff3db	Merge pull request #15584 from velconia/imperative_lr_scheduler ... Support imperative learning rate scheduler	6 years ago
chengduo	bb80dae7d0	Add DecoupledWeightDecay (#16427) ... * Add DecoupledWeightDecay	6 years ago