Paddle

Commit Graph

Author	SHA1	Message	Date
123malin	aa3b4ed717	【paddle.fleet】geo send sparse optimize (#27719 ) * test=develop, fix geo sgd communicator * test=develop, gloo_init_method * test=develop, bug fix for gloo http_init	4 years ago
danleifeng	8d7908f3fd	【paddle.fleet】raise error when using multi-cards in fleet non_distributed mode (#27854 ) * raise error if use multi-cards in fleet non_distributed mode; test=develop	4 years ago
Chengmo	328cb289ed	【paddle.fleet】fix sparse load (#27680 ) * add sparse tensor load method	4 years ago
123malin	a4f850748a	【paddle.fleet】bug fix for parameter_recv (#27838 ) * test=develop, bug fix for parameter_recv * test=develop, for unittest, test_fleet_rolemaker_new	4 years ago
Chen Weihang	ed31dac6eb	remove scale loss and coll grads, test=document_fix (#27874 )	4 years ago
WangXi	50619cd842	use floyd algorithm to find meta optimizer max path, test=develop (#27867 )	4 years ago
mapingshuo	8d2cb14f98	support gradient merge with recompute, test=develop (#27834 ) * support gradient merge with recompute, test=develop test=develop	4 years ago
Chengmo	c5f2802d56	【paddle.fleet】Update fleetrun & ps-heter (#27472 ) * refine fleetrun.ps_launch * update fleet run for multi device support * ps_graph support ps-gpu * fix heter save * add heter save unittest * fix unittest & simple code * update fleetrun * fix fleetrun * fix launch barrier * fix role maker * add paddlecloud rolemaker unittest * rename heter_worker_device_guard	4 years ago
WangXi	0a1862d1d2	fleet combine amp dgc recompute meta optimizer (#27643 )	4 years ago
danleifeng	a01bc6b31d	【paddle.fleet】fleet support non_distributed training in dygraph mode (#27714 ) * fleet support non_distributed training in dygraph mode; test=develop	4 years ago
lilong12	742cbe6660	[bug fix] avoiding multiple initialization of gloo for fleet in dygraph mode (#27706 ) * add double grad for expand, test=develop	4 years ago
lilong12	5132f5129d	terminate http server used by gloo for fleet after init (#27698 )	4 years ago
lilong12	bbc2add703	Initialize gloo for low level collective apis (#27672 ) * add gloo initializer, test=develop	4 years ago
Qinghe JING	1539a23822	Fix bugs in hdfs download (#27344 ) * set default value to strategy in distributed_optimizer test=develop	4 years ago
yaoxuefeng	780140599f	【paddle.distributed.fleet】add data_generator in distributed.fleet.dataset (#27345 )	4 years ago
lilong12	36c0410223	Revert "Initialize gloo for low level collective apis (#27356 )", test=document_fix (#27665 )	4 years ago
123malin	6822307745	test=develop, rm netifaces (#27581 ) * test=develop, rm netifaces	4 years ago
lilong12	fa73e4a284	Initialize gloo for low level collective apis (#27356 ) * add gloo initializer, test=develop	4 years ago
Dong Daxiang	4e8f18ab25	Get final strategy (#27602 ) * add get final strategy for user to print final strategy	4 years ago
Chengmo	0e101c4f6f	Fix test dist fleet heter ctr (#27513 ) * fix test_dist_fleet_heter_ctr & peformance update	4 years ago
WangXi	e550fc02ae	fleet2.0 add fp16 grad compression (#27480 )	4 years ago
123malin	32ad4f90a4	【paddle.fleet】 Usages Change: from fleet.util() to fleet.util (#27468 ) * test=develop, bug fix	4 years ago
tangwei12	bc5f0246a8	large scale kv speedup (#26510 ) * rename communicator meet->BatchesCounter * fix parame recv for sparse * geo sparse init from pserver * optimize init from pserver * add large scale optimizer fuse(SGD/ADAM) * rectification init_worker and exe.run startup program	4 years ago
danleifeng	0721767ba9	fix server_num bug;test=develop (#27442 )	4 years ago
danleifeng	905e2346ac	add endpoints log;test=develop (#27439 )	4 years ago
danleifeng	fc61efd736	fix port env bug(int);test=develop (#27405 )	4 years ago
tangwei12	d6b54de467	【paddle.fleet】Fix/role maker api fix (#27326 ) * fix fleet util and gloo * fix worker endpoints * fix * fix UT * fix gloo * fix gloo * update gloo * update gloo * update gloo * update gloo * update gloo * fix gloo wrapper for hdfs * add file gloo and UT * fix UT * fix UT * fix UT * hide public method of RoleMaker * fix UT * GPU fleetrun support gloo * parameterserver fleetrun support gloo * add UT * add UT * fix UT * fix get server endpoint * fix get server endpoint * fix UT * hide public method of rolemaker * hide public method of rolemaker * hide public method of rolemaker * Update test_fleet_rolemaker_new.py * hide public method of rolemaker * hide public method of rolemaker	4 years ago
tangwei12	99626502f7	【paddle.fleet】gloo and util (#27213 ) * fix worker endpoints * fix gloo wrapper for hdfs * GPU fleetrun support gloo * parameterserver fleetrun support gloo * fix get server endpoint	4 years ago
123malin	f36b9a7f79	【Fleet2.0 Util】 add documents (#26698 ) * test=develop, util documents	4 years ago
danleifeng	8d05c00c67	fix paddle.fleet en-doc for apis in dynamic mode (#27354 ) * fix fleet dynamic-mode en-doc;test=develop	4 years ago
ShenLiang	746a8ded29	fix comment of adaptive lsgd (#27362 )	4 years ago
gongweibao	11bcf0e21c	Cleanup redundant code files (#27319 )	4 years ago
ShenLiang	54b81fa32c	add adaptivelsgd in meta_optimizer (#27289 ) * add adaptivelsgd * Todo fix the code to avoid the conflict.	4 years ago
yaoxuefeng	c67c391682	refine fleet dataset class api (#27133 )	4 years ago
danleifeng	389a9a7e0e	fix ports conflict when use paddlecloud to launch analogue multi-nodes (#26191 ) * fix ports conflict when launching multi-nodes in paddlecloud;test=develop * add DISTRIBUTED_TRAINER_ENDPOINTS env for cloud;test=develop	4 years ago
mapingshuo	9dedafa0df	fix strategy, test=develop (#27323 ) * fix strategy, test=develop * fix can_apply	4 years ago
ShenLiang	2b6a5793fe	remove auto mode from localsgd optimizer (#27237 ) * rm auto from localsgd	4 years ago
123malin	60c3ef3ab8	【paddle.fleet】parameter_server_optimizer support auto_strategy (#27181 ) * parameter_server_optimizer support auto_strategy	5 years ago
JZ-LIANG	5d039f4086	modified the implement of Lars optimizer (#26733 ) add lars to fleet meta optimizer	5 years ago
Dong Daxiang	f7d08b7db8	【paddle.fleet】refine launch and distributed repr string for print (#27093 ) * refine launch and distributed repr string for print	5 years ago
123malin	f2d68d3ed5	【paddle.fleet】parameter_server_optimizer support auto_strategy (#26838 ) * test=develop, add ps auto	5 years ago
ShenLiang	aca450f6fb	fix the localsgd optimizer (#27094 ) * fix the localsgd	5 years ago
Dong Daxiang	0443b480b8	【paddle.fleet】add auto parallel L1 implementations (#27090 ) * add auto parallel L1 implementation test=develop	5 years ago
Chengmo	a72752263b	support heter-xpu-ps (#27018 ) support heter-xpu-ps	5 years ago
mapingshuo	9e4fe92303	fix strategy example (#26856 ) * fix doc * test=develop * test=develop * test=develop * test=develop * test=develop * test=develop * test=develop * test=develop * fix doc, test=develop * update localsgd doc test=develop * update localsgd doc test=develop * fix fleet dgc amp doc, test=develop * fix, test=develop * fix async configs Co-authored-by: liuyi05 <gavin1332@gmail.com> Co-authored-by: WangXi <wangxi16@baidu.com> Co-authored-by: seiriosPlus <tangwei12@baidu.com>	5 years ago
danleifeng	6b4ca0d7f1	【paddle.fleet】distributed_optimizer supports dygraph (#26541 ) paddle.distributed.fleet supports dynamic graph execution.	5 years ago
danleifeng	3a2a711681	【paddle.fleet】simplify fleetrun log infos (#26888 ) * print detailed and clear log infos; test=develop	5 years ago
danleifeng	e35ad3eee8	【paddle.fleet】support running python train.py for fleet tasks (#26249 ) * support running python train.py for fleet-task; test=develop	5 years ago
Chengmo	d0962abd20	supplement bug fix of parameter server (#26217 ) * fix fluid.embedding	5 years ago
tangwei12	9ded7565ec	【paddle.fleet】FleetAPI 2.0 (#26772 ) * add FleetAPI doc Co-authored-by: liuyuhui <liuyuhui@baidu.com>	5 years ago
Chengmo	7f2aa2db3c	【paddle.fleet】Support Heter Parameter Server (#25998 ) * Support Heter Parameter Server	5 years ago
Dong Daxiang	994217ea05	【paddle.fleet】fix api documents (#26777 ) * fix api document	5 years ago
Yi Liu	2024ef69a2	【paddle.fleet】add comments about localsgd in DistributedStrategy (#26709 ) * modified timeout value on windows and mac (#26690) * add Local SGD algorithm referenced paper test=develop	5 years ago
JZ-LIANG	958d7212c7	【paddle.fleet】Document refine lars & lamb (#26533 )	5 years ago
Dong Daxiang	08d736ad78	【paddle.fleet】add cudnn related strategies to DistributedStrategy (#26598 ) * add cudnn related strategies to DistributedStrategy	5 years ago
WangXi	7ff197d3ba	Add fleet dgc amp doc, test=document_fix (#26608 )	5 years ago
liuyuhui	66596bd20f	【paddle.fleet】solve the initial configuration about fleet and rolemaker (#26368 ) * solve the initial configuration about fleet and rolemaker Co-authored-by: seiriosPlus <tangwei12@baidu.com>	5 years ago
Dong Daxiang	7d3e46e1d5	【paddle.fleet】Document refine (#26526 ) * add documentation for DistributedStrategy	5 years ago
Dong Daxiang	83cd185947	【paddle.fleet】Meta from optimizer (#26392 ) * consider the combination of different strategies to work together	5 years ago
123malin	57d434df5d	add save/load for parameter server (#26235 ) * add save/load for parameter server	5 years ago
mapingshuo	cd48bdad31	add feature to fleet2.0 role_maker, distribute_strategy, test=develop (#26267 ) * add feature to fleet2.0 role_maker, distribute_strategy, test=develop	5 years ago
Dong Daxiang	4ec51e0205	【paddle.fleet】Clear disable (#26334 ) * add check approval test=develop	5 years ago
Yi Liu	3b2c580a66	【paddle.fleet】make fleet_localsgd_meta_optimizer work (#26213 ) * make fleet_localsgd_meta_optimizer work * fix bug in localsgd meta optimizer	5 years ago
Qinghe JING	d549a9b1fe	【paddle.fleet】Set default value to strategy in distributed_optimizer (#26246 ) * set default value to strategy in distributed_optimizer test=develop	5 years ago
liuyuhui	935da32d25	【paddle.fleet】upgrade fleet: modify role_maker (#26038 ) * add unittest for paddlerolemaker with gloo	5 years ago
Dong Daxiang	50a5bcfc9d	【paddle.fleet】paddle.fleet -> paddle.distributed.fleet. (#26186 ) * move paddle.fleet to paddle.distributed.fleet	5 years ago

1 2 3

116 Commits (06a3e3114899e4d6a5c621d34d38c401e071d1f0)