165 Commits (c90d35564be5fc4d51e8c129ee2e908c1e36c4fe)

Author	SHA1	Message	Date
Chengmo	c5f2802d56	【paddle.fleet】Update fleetrun & ps-heter (#27472) ... * refine fleetrun.ps_launch * update fleet run for multi device support * ps_graph support ps-gpu * fix heter save * add heter save unittest * fix unittest & simple code * update fleetrun * fix fleetrun * fix launch barrier * fix role maker * add paddlecloud rolemaker unittest * rename heter_worker_device_guard	4 years ago
123malin	cc780b1977	test=develop, optimize geo communicator (#26857) ... * test=develop, optimize geo communicator	4 years ago
lilong12	bbc2add703	Initialize gloo for low level collective apis (#27672) ... * add gloo initializer, test=develop	4 years ago
yaoxuefeng	780140599f	【paddle.distributed.fleet】add data_generator in distributed.fleet.dataset (#27345)	4 years ago
lilong12	36c0410223	Revert "Initialize gloo for low level collective apis (#27356)", test=document_fix (#27665)	4 years ago
123malin	6822307745	test=develop, rm netifaces (#27581) ... * test=develop, rm netifaces	4 years ago
lilong12	fa73e4a284	Initialize gloo for low level collective apis (#27356) ... * add gloo initializer, test=develop	4 years ago
tangwei12	bc5f0246a8	large scale kv speedup (#26510) ... * rename communicator meet->BatchesCounter * fix parame recv for sparse * geo sparse init from pserver * optimize init from pserver * add large scale optimizer fuse(SGD/ADAM) * rectification init_worker and exe.run startup program	4 years ago
tangwei12	d6b54de467	【paddle.fleet】Fix/role maker api fix (#27326) ... * fix fleet util and gloo * fix worker endpoints * fix * fix UT * fix gloo * fix gloo * update gloo * update gloo * update gloo * update gloo * update gloo * fix gloo wrapper for hdfs * add file gloo and UT * fix UT * fix UT * fix UT * hide public method of RoleMaker * fix UT * GPU fleetrun support gloo * parameterserver fleetrun support gloo * add UT * add UT * fix UT * fix get server endpoint * fix get server endpoint * fix UT * hide public method of rolemaker * hide public method of rolemaker * hide public method of rolemaker * Update test_fleet_rolemaker_new.py * hide public method of rolemaker * hide public method of rolemaker	4 years ago
123malin	f36b9a7f79	【Fleet2.0 Util】 add documents (#26698) ... * test=develop, util documents	4 years ago
gongweibao	11bcf0e21c	Cleanup redundant code files (#27319)	4 years ago
123malin	f2d68d3ed5	【paddle.fleet】parameter_server_optimizer support auto_strategy (#26838) ... * test=develop, add ps auto	5 years ago
Chengmo	c4846196b8	fix Heter Ps multi thread (#26876) ... * fix heter-ps multi thread	5 years ago
Chengmo	d0962abd20	supplement bug fix of parameter server (#26217) ... * fix fluid.embedding	5 years ago
yaoxuefeng	a47d92d868	fleet add save with whitelist test=develop (#23376)	5 years ago
Chengmo	7f2aa2db3c	【paddle.fleet】Support Heter Parameter Server (#25998) ... * Support Heter Parameter Server	5 years ago
tangwei12	8e4ed662d1	fix decay global counter (#26387) ... * fix decay global counter * remove unused print, test=distp0	5 years ago
Chengmo	eeeef957c7	Fix ps gpu (#26218) ... * support ps-gpu	5 years ago
Dong Daxiang	50a5bcfc9d	【paddle.fleet】paddle.fleet -> paddle.distributed.fleet. (#26186) ... * move paddle.fleet to paddle.distributed.fleet	5 years ago
gongweibao	a7c5210051	Fix test_hdfs bug. (#26068) ... * fix merge3 test=develop	5 years ago
gongweibao	0067a2e4ec	Save checkpoint automatically (#25917)	5 years ago
tangwei12	3755564ae1	Fix/large scale fix (#25999) ... * fix large scale KV * fix single training using async ssa graph	5 years ago
123malin	2191a08317	【paddle.fleet】fleet_util move to paddle.fleet (#25805) ... * test=develop,test=document_fix, remove the out args * fleet_util move to paddle.fleet Co-authored-by: WuHaobo <wuhaobo1994@gmail.com> Co-authored-by: tangwei12 <tangwei12@baidu.com>	5 years ago
Thunderbrook	0cb60c700d	add heter ps mode (#25682) ... * add heter ps mode * code style test=develop * add with_pslib test=develop * unitest test=develop * code style test=develop * code style test=develop * code style test=develop * code style test=develop * code style test=develop * code style test=develop * code style test=develop * code style test=develop * test monitor test=develop * prepare trainer test=develop * code style test=develop	5 years ago
gentelyang	6773fcc1ba	fix stratege.set_program_config (#25864)	5 years ago
tangwei12	caa90a6510	Integrated Trainer of Parameter Server (API add `fluid.contrib.layers.sparse_embedding` only) (#22957) ... * Integrated Trainer of Parameter Server	5 years ago
gongweibao	80f1c50738	Fix typo in interface. (#24779)	5 years ago
xujiaqi01	3016a4ac27	add mock barrier all (#24786) ... * add mock barrier all test=develop * fix test=develop * fix test=develop * fix test=develop	5 years ago
xujiaqi01	1034ca316f	add timeout and http store in communication (#23436) ... * add timeout and http store in communication, add revert and confirm in fleet * test=develop	5 years ago
mapingshuo	f0e743f136	fix AMP and recompute (#23551) ... * allow amp and recompute working together	5 years ago
Chengmo	ddd604446b	Fix judge pslib transpiler (#23720) ... * fix judge pslib & ranspiler	5 years ago
xujiaqi01	15ce8e21d8	add unit accessor (#23703) ... * add unit accessor in fleet, support DownpourUnitAccessor * test=develop	5 years ago
xujiaqi01	70f7c23fd2	fix add dense table (#23681) ... * fix add dense table test=develop * fix test=develop * fix test=develop	5 years ago
xujiaqi01	d98084e7ec	add save with prefix (#23449) ... * add save with prefix * test=develop	5 years ago
gongweibao	24a063f6ac	Add fleet checkpoint on local fs and remote fs(such as hdfs) for EDL (#22586)	5 years ago
xujiaqi01	21f59779ea	fix dump slot in strategy (#23398)	5 years ago
xujiaqi01	3a45767d49	add fleet pslib pull and push sparse op and push dense op (#23139) ... * add fleet pslib pull and push sparse op and push dense op * test=develop	5 years ago
xujiaqi01	c8f9e66b71	fix no_cvm in config_fleet (#22818) ... * fix no cvm, when accessor is DownpourSparseValueAccessor, set no_cvm=True * test=develop	5 years ago
xujiaqi01	68ea1ad55b	add clear one table (#23089) ... * add clear_one_table * test=develop	5 years ago
yaoxuefeng	995a6376f7	add pslib SparseDoubleTable test=develop (#23053)	5 years ago
tangwei12	c4a6a0e2e4	Revert "Integrated API of Parameter Server (#22710)" test=develop (#23071) ... This reverts commit 66fce9e824.	5 years ago
tangwei12	66fce9e824	Integrated API of Parameter Server (#22710) ... Fleet Parameter Server API Integrated	5 years ago
yaoxuefeng	c5cbe7f07b	fix add grad bug test=develop (#22924) ... * fix add grad bug test=develop * update style test=develop	5 years ago
123malin	0f9d40816e	test=develop, optimize distributedstrategy (#22677) ... * test=develop, optimize distributedstrategy	5 years ago
tianshuo78520a	433cef03e5	fix typo word (#22784)	5 years ago
tianshuo78520a	d2ba91aad1	fix typo words (#22653)	5 years ago
tangwei12	66a3150135	SYNC with communicaotor (#22344) ... * add sync communicator and implement	5 years ago
123malin	00594c1c88	support dumping params/grads in transpiler mode (#22490)	5 years ago
123malin	e59463efc7	test=develop, add distributed tools (#22623)	5 years ago
tangwei12	1aab3e61c9	add texttable for pretty flag output (#22584) ... pretty print for communicator flag	5 years ago