Paddle

Commit Graph

Author	SHA1	Message	Date
Thunderbrook	565354f676	support save multi sparse table in one path (#31108 ) * save multi table one path * format	5 years ago
Chengmo	528e03fc08	【Paddle.Fleet】Fix tensor table (#30075 ) * add tensor table	5 years ago
Thunderbrook	0b8e1fadc5	add topo-aware in heter-ps (#30087 ) * add topo aware * resource.h * topo aware * format	5 years ago
tangwei12	032414ca2a	[Feature] one ps (3/4) (#29604 ) * oneps (3/4) Co-authored-by: MrChengmo <cmchengmo@163.com> Co-authored-by: malin10 <malin10@baidu.com> Co-authored-by: chengmo <chengmo@baidu.com>	5 years ago
Thunderbrook	09b6e71928	heter box (#29734 ) * 　add heter box * add trainer, worker, wrapper... * format * for ci * format * remove boost get * boost & copyright * rename * 　rename * format * format * format Co-authored-by: yaoxuefeng6 <yaoxuefeng@baidu.com>	5 years ago
Zhen Wang	be3777a50a	Add pure fp16 training with master weights. (#27712 ) * add the weight decay func for the momentum op * Add the multi_precision function in Momentum Optimizer. * Make sure that the initial value of master weights are same with the fp16 weights. * add static loss scaling. * add the rescale_grad function in the pure fp16 training. * use the original momentum updating method. * Polish some codes, such as variable names. * add docstring for apis. * update the var creation details of _create_master_weight. * not modify codes about imperative momentum updating. * Fix the error of test_dist_sparse_tensor_load_momentum UT. * add unit test for multi precision fp16 training. * add more unit tests for CI. * Use lower threshold values for allclose comparing in test_multi_precision_fp16_train UT. * For CI Coverage Checking.	5 years ago
123malin	b5c6342336	Update ps gpu (#29209 ) * fix paramete prefetch & device guard Co-authored-by: MrChengmo <cmchengmo@163.com> Co-authored-by: chengmo <chengmo@baidu.com>	5 years ago
yaoxuefeng	545df287fc	add user_define_dump (#28596 )	5 years ago
Leo Chen	3815d7aa40	Upgrade string literals to raw string (#28989 ) * upgrade comment string to raw string * fix string in * fix string with ' ' * revert update on comments * upgrade only necessary * fix sample code checker * fix comments with '''	5 years ago
Thunderbrook	0073f9bdb0	support ps-gpu (#28752 ) * ps gpu transpile * ps gpu * remove op * gps trainer * local ps * add macro * HeterBox * def cuda * tab * code style * style Co-authored-by: Thunderbrook <a754913769#163.com>	5 years ago
Chengmo	4dc8c44ba1	【Paddle.Fleet】Fix fleetrun heter (#28252 ) * fix fleetrun heter ps on paddlecloud	6 years ago
123malin	aa3b4ed717	【paddle.fleet】geo send sparse optimize (#27719 ) * test=develop, fix geo sgd communicator * test=develop, gloo_init_method * test=develop, bug fix for gloo http_init	6 years ago
Chengmo	328cb289ed	【paddle.fleet】fix sparse load (#27680 ) * add sparse tensor load method	6 years ago
zhang wenhui	5a83496c8d	Multi task (#26002 ) * add multitask * add multitask, test=develop * fix code style, test=develop * add partail push dense, test=develop * fix has_kay in py3, test=develop * fix, test=develop * fix, test=develop * fix, test=develop	6 years ago
Chengmo	c5f2802d56	【paddle.fleet】Update fleetrun & ps-heter (#27472 ) * refine fleetrun.ps_launch * update fleet run for multi device support * ps_graph support ps-gpu * fix heter save * add heter save unittest * fix unittest & simple code * update fleetrun * fix fleetrun * fix launch barrier * fix role maker * add paddlecloud rolemaker unittest * rename heter_worker_device_guard	6 years ago
123malin	cc780b1977	test=develop, optimize geo communicator (#26857 ) * test=develop, optimize geo communicator	6 years ago
tangwei12	bc5f0246a8	large scale kv speedup (#26510 ) * rename communicator meet->BatchesCounter * fix parame recv for sparse * geo sparse init from pserver * optimize init from pserver * add large scale optimizer fuse(SGD/ADAM) * rectification init_worker and exe.run startup program	6 years ago
tangwei12	d6b54de467	【paddle.fleet】Fix/role maker api fix (#27326 ) * fix fleet util and gloo * fix worker endpoints * fix * fix UT * fix gloo * fix gloo * update gloo * update gloo * update gloo * update gloo * update gloo * fix gloo wrapper for hdfs * add file gloo and UT * fix UT * fix UT * fix UT * hide public method of RoleMaker * fix UT * GPU fleetrun support gloo * parameterserver fleetrun support gloo * add UT * add UT * fix UT * fix get server endpoint * fix get server endpoint * fix UT * hide public method of rolemaker * hide public method of rolemaker * hide public method of rolemaker * Update test_fleet_rolemaker_new.py * hide public method of rolemaker * hide public method of rolemaker	6 years ago
123malin	f2d68d3ed5	【paddle.fleet】parameter_server_optimizer support auto_strategy (#26838 ) * test=develop, add ps auto	6 years ago
Chengmo	c4846196b8	fix Heter Ps multi thread (#26876 ) * fix heter-ps multi thread	6 years ago
Chengmo	d0962abd20	supplement bug fix of parameter server (#26217 ) * fix fluid.embedding	6 years ago
yaoxuefeng	a47d92d868	fleet add save with whitelist test=develop (#23376 )	6 years ago
Chengmo	7f2aa2db3c	【paddle.fleet】Support Heter Parameter Server (#25998 ) * Support Heter Parameter Server	6 years ago
tangwei12	8e4ed662d1	fix decay global counter (#26387 ) * fix decay global counter * remove unused print, test=distp0	6 years ago
Chengmo	eeeef957c7	Fix ps gpu (#26218 ) * support ps-gpu	6 years ago
tangwei12	3755564ae1	Fix/large scale fix (#25999 ) * fix large scale KV * fix single training using async ssa graph	6 years ago
Thunderbrook	0cb60c700d	add heter ps mode (#25682 ) * add heter ps mode * code style test=develop * add with_pslib test=develop * unitest test=develop * code style test=develop * code style test=develop * code style test=develop * code style test=develop * code style test=develop * code style test=develop * code style test=develop * code style test=develop * test monitor test=develop * prepare trainer test=develop * code style test=develop	6 years ago
gentelyang	6773fcc1ba	fix stratege.set_program_config (#25864 )	6 years ago
tangwei12	caa90a6510	Integrated Trainer of Parameter Server (API add `fluid.contrib.layers.sparse_embedding` only) (#22957 ) * Integrated Trainer of Parameter Server	6 years ago
xujiaqi01	1034ca316f	add timeout and http store in communication (#23436 ) * add timeout and http store in communication, add revert and confirm in fleet * test=develop	6 years ago
xujiaqi01	15ce8e21d8	add unit accessor (#23703 ) * add unit accessor in fleet, support DownpourUnitAccessor * test=develop	6 years ago
xujiaqi01	70f7c23fd2	fix add dense table (#23681 ) * fix add dense table test=develop * fix test=develop * fix test=develop	6 years ago
xujiaqi01	d98084e7ec	add save with prefix (#23449 ) * add save with prefix * test=develop	6 years ago
xujiaqi01	21f59779ea	fix dump slot in strategy (#23398 )	6 years ago
xujiaqi01	3a45767d49	add fleet pslib pull and push sparse op and push dense op (#23139 ) * add fleet pslib pull and push sparse op and push dense op * test=develop	6 years ago
xujiaqi01	c8f9e66b71	fix no_cvm in config_fleet (#22818 ) * fix no cvm, when accessor is DownpourSparseValueAccessor, set no_cvm=True * test=develop	6 years ago
xujiaqi01	68ea1ad55b	add clear one table (#23089 ) * add clear_one_table * test=develop	6 years ago
yaoxuefeng	995a6376f7	add pslib SparseDoubleTable test=develop (#23053 )	6 years ago
tangwei12	c4a6a0e2e4	Revert "Integrated API of Parameter Server (#22710 )" test=develop (#23071 ) This reverts commit `66fce9e824`.	6 years ago
tangwei12	66fce9e824	Integrated API of Parameter Server (#22710 ) Fleet Parameter Server API Integrated	6 years ago
yaoxuefeng	c5cbe7f07b	fix add grad bug test=develop (#22924 ) * fix add grad bug test=develop * update style test=develop	6 years ago
123malin	0f9d40816e	test=develop, optimize distributedstrategy (#22677 ) * test=develop, optimize distributedstrategy	6 years ago
tianshuo78520a	433cef03e5	fix typo word (#22784 )	6 years ago
tianshuo78520a	d2ba91aad1	fix typo words (#22653 )	6 years ago
tangwei12	66a3150135	SYNC with communicaotor (#22344 ) * add sync communicator and implement	6 years ago
123malin	00594c1c88	support dumping params/grads in transpiler mode (#22490 )	6 years ago
tangwei12	1aab3e61c9	add texttable for pretty flag output (#22584 ) pretty print for communicator flag	6 years ago
tangwei12	b0675c8193	fix bug with compiledProgram (#22495 ) * add thread barrier for the compiled program	6 years ago
yaoxuefeng	2235ee1a5e	multi-loss optimization by adding a DownpourOpt worker (#22025 ) * update * update test=develop * update compile set test=develop * update compile set test=develop * update test=develop * update test=develop * update test=develop * update compile setting test=develop * update compile setting test=develop * update run demo test=develop * update test=develop * update test=develop * fix test=develop * update test=develop * update test=develop * update test=develop * update test=develop * update test=develop * update test=develop * update test=develop * update test=develop * update test=develop * update format test=develop * update format test=develop * update style test=develop * update style test=develop * change style test=develop * change style test=develop * change style test=develop * add dataset unittest test=develop * update test=develop * update for record test=develop * udpate style for record test=develop * update for record test=develop * update for record test=develop * update for record test=develop * fix format test=develop * update test=develop * update test=develop * update test=develop * update test=develop * update test=develop	6 years ago
tangwei12	7e2665c58b	fix bug with half (#22378 ) * fix bug with half communicator	6 years ago

1 2 3

126 Commits (cced930b61ba246dffec68bbe09bd9e22a142d64)