146 Commits (9a32dad811901820133e47637d4b7440db967c43)

Author	SHA1	Message	Date
hutuxian	969e6378b9	Pipeline Concurrency (#17402) ... Add Pipeline Concurrency Train Mode: - Cpp: pipeline_trainer & section_worker - Python: PipelineOptimizer - Add a new data_feed type: PrivateInstantDataFeed - Add a test demo of pipeline trainer and the test model is gnn - Do not support win32 now	6 years ago
Jiabin Yang	022dfed4fc	Add optimizer save and load (#16986) ... * save optimizer related vars in dygraph * test=develop, add optimizer save and load * test=develop, add optimizer save and load * test=develop, merge code and add multi-optimizer save and load * test=develop, fix test_imperative_checkpoint * test=develop, fix include error * test=develop, fix include error * test=develop, renew api spec * test=develop, refine code * test=develop, set default value for checkpoint * test=develop, fix ci error * test=develop, change API.spec and make api more readable * test=develop, refine version and time stamp * test=develop, add example code and refine code * test=develop, refine doc * test=develop, change version	6 years ago
Yibing Liu	d6d33fd748	Add update method for ema (#17812)	6 years ago
Zeng Jinle	3a6ead24ad	Add no_grad decorator to dygraph (#17790) ... * add no_grad decorator to dygraph, test=develop * add unittest,test=develop	6 years ago
lujun	ed9d603a8a	fix api doc: Optimizer.ModelAverage (#17395)	6 years ago
Hongyu Liu	9f85f21880	Add new gard clip [old gradient clip not support in dy graph] (#17523) ... * add gradient clip in minimize; test=develop * fix bug; test=develop * fix format; test=develop * move new grad clip to dygraph/grad_clip.py; test=develop * fix lr decay and grad clip test; test=develop * seperate dygraph grad clip; test=develop * fix grad clip test; develop * fix api spec bug; test=develop * add blank line, test=develop,test=document_preview to fix format problem	6 years ago
wopeizl	058f1f1e1b	fix the api example for create_global_var, create_parameter, SGDOptim… (#17371) ... * fix the api example for create_global_var, create_parameter, SGDOptimizer, RMSPropOptimizer, MomentumOptimizer, LarsMomentumOptimizer, FtrlOptimizer test=develop * add example for adamoptimizer fix API.spec test=develop * test=develop * test=develop	6 years ago
Yibing Liu	4f4f0993c1	Bias correction for exponential moving average (#17677) ... * Bias correction for exponential moving average test=develop, test=document_preview * Fix docs test=develop, test=document_preview	6 years ago
Zeng Jinle	887a39f050	Fix dygraph unique name bug (#17592) ... * fix unique_name growth bug in dygraph mode,test=develop * change generate_tmp to generate_with_ignorable_key,test=develop	6 years ago
Hongyu Liu	e53119f5b1	Fix decayed adagrad example (#17390) ... * fix DecayedAdagrad example; test=develop test=document_preview * add space; test=develop	6 years ago
Yibing Liu	6e11f97708	Add exponential moving average (#17562) ... * Add exponential moving average test=develop, test=document_preview * Polish documents test=develop, test=document_preview * Update API spec test=develop, test=document_preview	6 years ago
Qiao Longfei	58f7695ab2	Async exe support communicator (#17386) ... Async exe support communicator	6 years ago
Yibing Liu	f9796b1249	Add LAMB Optimizer support (#17489) ... * Add LAMB optimizer * Expose LAMB Optimizer's APIs test=develop, test=document_preview * Cleanup code & doc test=develop, test=document_preview * Update lamb optimizer's formula test=develop	6 years ago
Zeng Jinle	65dd7ec2d6	add clear ops in dygraph optimizers,test=develop (#17484)	6 years ago
Jiabin Yang	15453d05a8	test=develop, fix AdgradOptimizer example code (#17401)	6 years ago
chengduo	d915a04907	Add examples for AdamaxOptimizer (#17381) ... test=develop	6 years ago
gongweibao	91784f8ec3	Fix code in document. (#17237)	6 years ago
gongweibao	cbdb8a17b1	Polish DGC code (#16818)	6 years ago
minqiyang	08a7cdee11	Polish code ... test=develop	6 years ago
minqiyang	20ead9e659	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into imperative_fix_growing_dict ... test=develop	6 years ago
lujun	9bd44b94da	Merge pull request #16561 from junjun315/move-api-to-root ... Move dygraph api to root	6 years ago
gongweibao	95410652e8	Fix dgc spelling mistakes. (#16733)	6 years ago
minqiyang	9434f9a6f9	Fix auto growth bug of optimizer in dygraph mode ... test=develop	6 years ago
lujun	92c8ac8a74	merge conflict, test=develop	6 years ago
gongweibao	8b793d0efd	Fix DGC bug. (#16697)	6 years ago
lujun	01f4f2d7e4	merge confict, test=develop	6 years ago
gongweibao	0342f01249	Fix dgc bug. (#16602)	6 years ago
Qiyang Min	d8d73ff3db	Merge pull request #15584 from velconia/imperative_lr_scheduler ... Support imperative learning rate scheduler	6 years ago
chengduo	bb80dae7d0	Add DecoupledWeightDecay (#16427) ... * Add DecoupledWeightDecay	6 years ago
minqiyang	34426e761e	Polish code ... test=develop	6 years ago
minqiyang	3e57981294	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into imperative_lr_scheduler ... test=develop	6 years ago
lujun	1c9aaeebe0	move imperative to dygraph, test=develop	6 years ago
minqiyang	48f3cbdf55	Polish code ... test=develop	6 years ago
minqiyang	35c89f38c3	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into imperative_lr_scheduler ... test=develop	6 years ago
gongweibao	eb83abeac3	Add DGC(Deep Gradient Compression) interface. (#15841)	6 years ago
minqiyang	99128a5c72	Implement Cosine and Noam Decay ... test=develop	6 years ago
Xin Pan	f8c279b11c	Merge pull request #16454 from panyx0718/imperative2 ... polish deepCF model to support real dataset	6 years ago
minqiyang	4278be8c49	Merge branch 'imperative_lr_scheduler' of https://github.com/velconia/Paddle into imperative_lr_scheduler ... test=develop	6 years ago
minqiyang	b5bbb13ac1	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into imperative_lr_scheduler	6 years ago
Jiabin Yang	f735102eab	add layer norm to Layers, add transformer test in imperative mode (#16092) ... * add layer norm to Layers, add transformer prepare encoding * little change * finish encoder part * add decoder part * finish model part * add test case and part of data feed * add transformer test * add to_parameter, add remove in set_attr * test=develop, fix pos encoding bug, create_parameter with stantard name * test=develop, rm dropout test in imperative * test=develop, fix cpu error * test=develop, fix minize bug * test=develop, fix one hot not stop gradient * test=develop, fix one hot not stop gradient * test=develop, refine parameter name * test=develop, fix transformer test in imperative mode * test=develop, fix transformer test in imperative mode * test=develop, fix boost and mkl download error * test=develop, fix boost and mkl download error * test=develop, fix ci and refine code * test=develop, fix ci and refine code	6 years ago
Xin Pan	fd24ab47ab	polish ... test=develop	6 years ago
phlrain	77a08750e9	add var name in optimizer; test=develop	6 years ago
Qiyang Min	1f4aa7a202	Imperative remove all descs (#16045) ... * Remove Desc in Forward Pass * Refactor VarBase * Add dbg info * Only check type in imperative mode * Polish code and support optimizer test=develop * Fix stop gradient problem in PyLayer test=develop	6 years ago
minqiyang	45c9f2a68a	Fix bugs in piecewise decay ... test=develop	6 years ago
minqiyang	feb39028c6	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into imperative_lr_scheduler	6 years ago
Jiabin Yang	654825cfe3	test=develop, reconstruct layer helper to fit imperative usage (#15938) ... * test=develop, reconstruct layer helper to fit imperative usage * test=develop, fix import error on py35 * test=develop, fix rnn gradient error * test=develop, delete test use code * test=develop, remove helper from imperative usage * test=develop, fix test_base_layer using new helper * test=develop, reconstruct layerhelper for imperative mode * test=develop, reconstruct layerhelper for imperative mode * test=develop, fix bug * test=develop, fix test failed bug * test=develop, fix test failed bug * test=develop, fix test failed bug * test=develop, fix bug * test=develop, polish code	6 years ago
xuezhong	46fcadec18	add parameter description ... test=develop	6 years ago
xuezhong	57294fa890	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into fix_bug_adagrad ... test=develop	6 years ago
xuezhong	794b90c93f	for backward compatibility	6 years ago
minqiyang	700495e11f	Fix FtrlOptimizer's API comment ... test=develop	6 years ago