26 Commits (rocm_dev_0217)

Author	SHA1	Message	Date
lilong12	dc8dfba35b	align the default value of some configuration for fleet to that of single cards (#30740) ... * update, test=develop	5 years ago
WangXi	31ed9c9eed	Fleet distributed strategy support pure fp16 (#30754)	5 years ago
JZ-LIANG	75936d838f	Recompute Offload (#30233)	5 years ago
ShenLiang	2ef9e0e23c	Rebuild group automatically in dynamic graph distributed (#29255) ... * add tensor_indices in AssignGroupBySize * add rebuild group in reducer	5 years ago
ShenLiang	46b73e6cd9	Change the api of DataParallel and Fleet (#29224)	5 years ago
123malin	cc9c619679	test=develop, fix doc (#29200) ... * fix fleet api doc	5 years ago
JZ-LIANG	0dadacc4eb	[sharding] doc, api, bug fixed (#28983) ... * add lars to fleet meta optimizer * add lamb to proto * add lamb to fleet meta optimizer * fixed syntax bug * fixed syntax bug * fixed syntax error in lamb, add config setter of lamb in distributed_strategy * trigger unitest to rerun * add new unitest func for lamb * revise unitest for lars and lamb * revise dgc meta unitest * revise lars document in distribute_strategy * revise lars lamb document in distributed_strategy.py * revise lars lamb document in distributed_strategy.py * add weight decay exclude logic to lars * restore optimzier.py * restore optimizer.py as develop except lars * add epsilon and exclude fn to distributed_sttrategy * add lars epsilon * revise unitest for fleet lars and lamb * revise lars lamb unitest for CI coverage * revise lars argument api * revise lars argument api * revise lars argument api * revise api doc of lars * fix op role * add sharding save and add_sync_comm_for_test function * add comm_analyse to utlis * revise sharding_utils * add sharding saving unittest * revise sharding utils for unittest * revise sharding en doc * update sharding utils api * add doc for sharding * fixed bug in sharding var size count * update varsize count in sharding * fix sharding num_nccl_comm * Revert "fix sharding num_nccl_comm" This reverts commit d51587c15e9323acf226ddd36154275f0d1daf76.	5 years ago
Leo Chen	3815d7aa40	Upgrade string literals to raw string (#28989) ... * upgrade comment string to raw string * fix string in * fix string with ' ' * revert update on comments * upgrade only necessary * fix sample code checker * fix comments with '''	5 years ago
mapingshuo	81244fbfab	add sharding strategy in fleet(#27900) ... * add sharding	6 years ago
WangXi	11acbfae06	refine auto strategy, test=document_fix (#28211)	6 years ago
WangXi	0a1862d1d2	fleet combine amp dgc recompute meta optimizer (#27643)	6 years ago
Dong Daxiang	4e8f18ab25	Get final strategy (#27602) ... * add get final strategy for user to print final strategy	6 years ago
WangXi	e550fc02ae	fleet2.0 add fp16 grad compression (#27480)	6 years ago
ShenLiang	54b81fa32c	add adaptivelsgd in meta_optimizer (#27289) ... * add adaptivelsgd * Todo fix the code to avoid the conflict.	6 years ago
ShenLiang	2b6a5793fe	remove auto mode from localsgd optimizer (#27237) ... * rm auto from localsgd	6 years ago
Dong Daxiang	f7d08b7db8	【paddle.fleet】refine launch and distributed repr string for print (#27093) ... * refine launch and distributed repr string for print	6 years ago
Dong Daxiang	0443b480b8	【paddle.fleet】add auto parallel L1 implementations (#27090) ... * add auto parallel L1 implementation test=develop	6 years ago
mapingshuo	9e4fe92303	fix strategy example (#26856) ... * fix doc * test=develop * test=develop * test=develop * test=develop * test=develop * test=develop * test=develop * test=develop * fix doc, test=develop * update localsgd doc test=develop * update localsgd doc test=develop * fix fleet dgc amp doc, test=develop * fix, test=develop * fix async configs Co-authored-by: liuyi05 <gavin1332@gmail.com> Co-authored-by: WangXi <wangxi16@baidu.com> Co-authored-by: seiriosPlus <tangwei12@baidu.com>	6 years ago
Dong Daxiang	994217ea05	【paddle.fleet】fix api documents (#26777) ... * fix api document	6 years ago
Yi Liu	2024ef69a2	【paddle.fleet】add comments about localsgd in DistributedStrategy (#26709) ... * modified timeout value on windows and mac (#26690) * add Local SGD algorithm referenced paper test=develop	6 years ago
JZ-LIANG	958d7212c7	【paddle.fleet】Document refine lars & lamb (#26533)	6 years ago
Dong Daxiang	08d736ad78	【paddle.fleet】add cudnn related strategies to DistributedStrategy (#26598) ... * add cudnn related strategies to DistributedStrategy	6 years ago
WangXi	7ff197d3ba	Add fleet dgc amp doc, test=document_fix (#26608)	6 years ago
Dong Daxiang	7d3e46e1d5	【paddle.fleet】Document refine (#26526) ... * add documentation for DistributedStrategy	6 years ago
mapingshuo	cd48bdad31	add feature to fleet2.0 role_maker, distribute_strategy, test=develop (#26267) ... * add feature to fleet2.0 role_maker, distribute_strategy, test=develop	6 years ago
Dong Daxiang	50a5bcfc9d	【paddle.fleet】paddle.fleet -> paddle.distributed.fleet. (#26186) ... * move paddle.fleet to paddle.distributed.fleet	6 years ago