185 Commits (e429deb0c42c51a647bfc9d90e41be0382bded8a)

Author	SHA1	Message	Date
Chengmo	09482ddec4	【Paddle.Fleet】Fix one ps gradient clip (#31664) ... * fix one ps gradient clip	4 years ago
Thunderbrook	3789a69923	solve bug in heter mode (#31531) ... * heter bug * format * format	4 years ago
Thunderbrook	c4f279fe8d	support multi node in heterps (#31102) ... * push multi node * multi node * MultiThread * remove log * solve bug in 30829	4 years ago
tangwei12	ebbdf52557	fix entry (#31079) ... * fix entry * fix distributed lookup table fuse case * fix entry bug at first time * move entry from paddle.fluid -> paddle.distributed * fix ut with paddle.enable_static() Co-authored-by: malin10 <malin10@baidu.com>	4 years ago
Thunderbrook	565354f676	support save multi sparse table in one path (#31108) ... * save multi table one path * format	4 years ago
Chengmo	528e03fc08	【Paddle.Fleet】Fix tensor table (#30075) ... * add tensor table	4 years ago
Thunderbrook	0b8e1fadc5	add topo-aware in heter-ps (#30087) ... * add topo aware * resource.h * topo aware * format	4 years ago
tangwei12	032414ca2a	[Feature] one ps (3/4) (#29604) ... * oneps (3/4) Co-authored-by: MrChengmo <cmchengmo@163.com> Co-authored-by: malin10 <malin10@baidu.com> Co-authored-by: chengmo <chengmo@baidu.com>	5 years ago
Thunderbrook	09b6e71928	heter box (#29734) ... * 　add heter box * add trainer, worker, wrapper... * format * for ci * format * remove boost get * boost & copyright * rename * 　rename * format * format * format Co-authored-by: yaoxuefeng6 <yaoxuefeng@baidu.com>	5 years ago
Zhen Wang	be3777a50a	Add pure fp16 training with master weights. (#27712) ... * add the weight decay func for the momentum op * Add the multi_precision function in Momentum Optimizer. * Make sure that the initial value of master weights are same with the fp16 weights. * add static loss scaling. * add the rescale_grad function in the pure fp16 training. * use the original momentum updating method. * Polish some codes, such as variable names. * add docstring for apis. * update the var creation details of _create_master_weight. * not modify codes about imperative momentum updating. * Fix the error of test_dist_sparse_tensor_load_momentum UT. * add unit test for multi precision fp16 training. * add more unit tests for CI. * Use lower threshold values for allclose comparing in test_multi_precision_fp16_train UT. * For CI Coverage Checking.	5 years ago
123malin	b5c6342336	Update ps gpu (#29209) ... * fix paramete prefetch & device guard Co-authored-by: MrChengmo <cmchengmo@163.com> Co-authored-by: chengmo <chengmo@baidu.com>	5 years ago
123malin	92817f8005	test=develop, rm pathlib (#28658) ... * test=develop, rm pathlib	5 years ago
yaoxuefeng	545df287fc	add user_define_dump (#28596)	5 years ago
Leo Chen	3815d7aa40	Upgrade string literals to raw string (#28989) ... * upgrade comment string to raw string * fix string in * fix string with ' ' * revert update on comments * upgrade only necessary * fix sample code checker * fix comments with '''	5 years ago
Thunderbrook	0073f9bdb0	support ps-gpu (#28752) ... * ps gpu transpile * ps gpu * remove op * gps trainer * local ps * add macro * HeterBox * def cuda * tab * code style * style Co-authored-by: Thunderbrook <a754913769#163.com>	5 years ago
Chengmo	4dc8c44ba1	【Paddle.Fleet】Fix fleetrun heter (#28252) ... * fix fleetrun heter ps on paddlecloud	5 years ago
MRXLT	55098b975e	fleet support paddle.optimzier (#28026) ... fleet support paddle.optimzier * bug fix * fix fleet_base * bug fix * fix coverage	5 years ago
123malin	aa3b4ed717	【paddle.fleet】geo send sparse optimize (#27719) ... * test=develop, fix geo sgd communicator * test=develop, gloo_init_method * test=develop, bug fix for gloo http_init	5 years ago
Chengmo	328cb289ed	【paddle.fleet】fix sparse load (#27680) ... * add sparse tensor load method	5 years ago
zhang wenhui	5a83496c8d	Multi task (#26002) ... * add multitask * add multitask, test=develop * fix code style, test=develop * add partail push dense, test=develop * fix has_kay in py3, test=develop * fix, test=develop * fix, test=develop * fix, test=develop	5 years ago
Chengmo	c5f2802d56	【paddle.fleet】Update fleetrun & ps-heter (#27472) ... * refine fleetrun.ps_launch * update fleet run for multi device support * ps_graph support ps-gpu * fix heter save * add heter save unittest * fix unittest & simple code * update fleetrun * fix fleetrun * fix launch barrier * fix role maker * add paddlecloud rolemaker unittest * rename heter_worker_device_guard	5 years ago
123malin	cc780b1977	test=develop, optimize geo communicator (#26857) ... * test=develop, optimize geo communicator	5 years ago
lilong12	bbc2add703	Initialize gloo for low level collective apis (#27672) ... * add gloo initializer, test=develop	5 years ago
yaoxuefeng	780140599f	【paddle.distributed.fleet】add data_generator in distributed.fleet.dataset (#27345)	5 years ago
lilong12	36c0410223	Revert "Initialize gloo for low level collective apis (#27356)", test=document_fix (#27665)	5 years ago
123malin	6822307745	test=develop, rm netifaces (#27581) ... * test=develop, rm netifaces	5 years ago
lilong12	fa73e4a284	Initialize gloo for low level collective apis (#27356) ... * add gloo initializer, test=develop	5 years ago
tangwei12	bc5f0246a8	large scale kv speedup (#26510) ... * rename communicator meet->BatchesCounter * fix parame recv for sparse * geo sparse init from pserver * optimize init from pserver * add large scale optimizer fuse(SGD/ADAM) * rectification init_worker and exe.run startup program	5 years ago
tangwei12	d6b54de467	【paddle.fleet】Fix/role maker api fix (#27326) ... * fix fleet util and gloo * fix worker endpoints * fix * fix UT * fix gloo * fix gloo * update gloo * update gloo * update gloo * update gloo * update gloo * fix gloo wrapper for hdfs * add file gloo and UT * fix UT * fix UT * fix UT * hide public method of RoleMaker * fix UT * GPU fleetrun support gloo * parameterserver fleetrun support gloo * add UT * add UT * fix UT * fix get server endpoint * fix get server endpoint * fix UT * hide public method of rolemaker * hide public method of rolemaker * hide public method of rolemaker * Update test_fleet_rolemaker_new.py * hide public method of rolemaker * hide public method of rolemaker	5 years ago
123malin	f36b9a7f79	【Fleet2.0 Util】 add documents (#26698) ... * test=develop, util documents	5 years ago
gongweibao	11bcf0e21c	Cleanup redundant code files (#27319)	5 years ago
123malin	f2d68d3ed5	【paddle.fleet】parameter_server_optimizer support auto_strategy (#26838) ... * test=develop, add ps auto	5 years ago
Chengmo	c4846196b8	fix Heter Ps multi thread (#26876) ... * fix heter-ps multi thread	5 years ago
Chengmo	d0962abd20	supplement bug fix of parameter server (#26217) ... * fix fluid.embedding	5 years ago
yaoxuefeng	a47d92d868	fleet add save with whitelist test=develop (#23376)	5 years ago
Chengmo	7f2aa2db3c	【paddle.fleet】Support Heter Parameter Server (#25998) ... * Support Heter Parameter Server	5 years ago
tangwei12	8e4ed662d1	fix decay global counter (#26387) ... * fix decay global counter * remove unused print, test=distp0	5 years ago
Chengmo	eeeef957c7	Fix ps gpu (#26218) ... * support ps-gpu	5 years ago
Dong Daxiang	50a5bcfc9d	【paddle.fleet】paddle.fleet -> paddle.distributed.fleet. (#26186) ... * move paddle.fleet to paddle.distributed.fleet	5 years ago
gongweibao	a7c5210051	Fix test_hdfs bug. (#26068) ... * fix merge3 test=develop	5 years ago
gongweibao	0067a2e4ec	Save checkpoint automatically (#25917)	5 years ago
tangwei12	3755564ae1	Fix/large scale fix (#25999) ... * fix large scale KV * fix single training using async ssa graph	5 years ago
123malin	2191a08317	【paddle.fleet】fleet_util move to paddle.fleet (#25805) ... * test=develop,test=document_fix, remove the out args * fleet_util move to paddle.fleet Co-authored-by: WuHaobo <wuhaobo1994@gmail.com> Co-authored-by: tangwei12 <tangwei12@baidu.com>	5 years ago
Thunderbrook	0cb60c700d	add heter ps mode (#25682) ... * add heter ps mode * code style test=develop * add with_pslib test=develop * unitest test=develop * code style test=develop * code style test=develop * code style test=develop * code style test=develop * code style test=develop * code style test=develop * code style test=develop * code style test=develop * test monitor test=develop * prepare trainer test=develop * code style test=develop	5 years ago
gentelyang	6773fcc1ba	fix stratege.set_program_config (#25864)	5 years ago
tangwei12	caa90a6510	Integrated Trainer of Parameter Server (API add `fluid.contrib.layers.sparse_embedding` only) (#22957) ... * Integrated Trainer of Parameter Server	5 years ago
gongweibao	80f1c50738	Fix typo in interface. (#24779)	5 years ago
xujiaqi01	3016a4ac27	add mock barrier all (#24786) ... * add mock barrier all test=develop * fix test=develop * fix test=develop * fix test=develop	5 years ago
xujiaqi01	1034ca316f	add timeout and http store in communication (#23436) ... * add timeout and http store in communication, add revert and confirm in fleet * test=develop	5 years ago
mapingshuo	f0e743f136	fix AMP and recompute (#23551) ... * allow amp and recompute working together	5 years ago