145 Commits (0067a2e4ec97563fe907b0079f9e599fe8336c84)

Author	SHA1	Message	Date
gongweibao	0067a2e4ec	Save checkpoint automatically (#25917)	5 years ago
tangwei12	3755564ae1	Fix/large scale fix (#25999) ... * fix large scale KV * fix single training using async ssa graph	5 years ago
123malin	2191a08317	【paddle.fleet】fleet_util move to paddle.fleet (#25805) ... * test=develop,test=document_fix, remove the out args * fleet_util move to paddle.fleet Co-authored-by: WuHaobo <wuhaobo1994@gmail.com> Co-authored-by: tangwei12 <tangwei12@baidu.com>	5 years ago
Thunderbrook	0cb60c700d	add heter ps mode (#25682) ... * add heter ps mode * code style test=develop * add with_pslib test=develop * unitest test=develop * code style test=develop * code style test=develop * code style test=develop * code style test=develop * code style test=develop * code style test=develop * code style test=develop * code style test=develop * test monitor test=develop * prepare trainer test=develop * code style test=develop	5 years ago
gentelyang	6773fcc1ba	fix stratege.set_program_config (#25864)	5 years ago
tangwei12	caa90a6510	Integrated Trainer of Parameter Server (API add `fluid.contrib.layers.sparse_embedding` only) (#22957) ... * Integrated Trainer of Parameter Server	5 years ago
gongweibao	80f1c50738	Fix typo in interface. (#24779)	5 years ago
xujiaqi01	3016a4ac27	add mock barrier all (#24786) ... * add mock barrier all test=develop * fix test=develop * fix test=develop * fix test=develop	5 years ago
xujiaqi01	1034ca316f	add timeout and http store in communication (#23436) ... * add timeout and http store in communication, add revert and confirm in fleet * test=develop	5 years ago
mapingshuo	f0e743f136	fix AMP and recompute (#23551) ... * allow amp and recompute working together	5 years ago
Chengmo	ddd604446b	Fix judge pslib transpiler (#23720) ... * fix judge pslib & ranspiler	5 years ago
xujiaqi01	15ce8e21d8	add unit accessor (#23703) ... * add unit accessor in fleet, support DownpourUnitAccessor * test=develop	5 years ago
xujiaqi01	70f7c23fd2	fix add dense table (#23681) ... * fix add dense table test=develop * fix test=develop * fix test=develop	5 years ago
xujiaqi01	d98084e7ec	add save with prefix (#23449) ... * add save with prefix * test=develop	5 years ago
gongweibao	24a063f6ac	Add fleet checkpoint on local fs and remote fs(such as hdfs) for EDL (#22586)	5 years ago
xujiaqi01	21f59779ea	fix dump slot in strategy (#23398)	5 years ago
xujiaqi01	3a45767d49	add fleet pslib pull and push sparse op and push dense op (#23139) ... * add fleet pslib pull and push sparse op and push dense op * test=develop	5 years ago
xujiaqi01	c8f9e66b71	fix no_cvm in config_fleet (#22818) ... * fix no cvm, when accessor is DownpourSparseValueAccessor, set no_cvm=True * test=develop	5 years ago
xujiaqi01	68ea1ad55b	add clear one table (#23089) ... * add clear_one_table * test=develop	5 years ago
yaoxuefeng	995a6376f7	add pslib SparseDoubleTable test=develop (#23053)	5 years ago
tangwei12	c4a6a0e2e4	Revert "Integrated API of Parameter Server (#22710)" test=develop (#23071) ... This reverts commit 66fce9e824.	5 years ago
tangwei12	66fce9e824	Integrated API of Parameter Server (#22710) ... Fleet Parameter Server API Integrated	5 years ago
yaoxuefeng	c5cbe7f07b	fix add grad bug test=develop (#22924) ... * fix add grad bug test=develop * update style test=develop	5 years ago
123malin	0f9d40816e	test=develop, optimize distributedstrategy (#22677) ... * test=develop, optimize distributedstrategy	5 years ago
tianshuo78520a	433cef03e5	fix typo word (#22784)	5 years ago
tianshuo78520a	d2ba91aad1	fix typo words (#22653)	5 years ago
tangwei12	66a3150135	SYNC with communicaotor (#22344) ... * add sync communicator and implement	5 years ago
123malin	00594c1c88	support dumping params/grads in transpiler mode (#22490)	5 years ago
123malin	e59463efc7	test=develop, add distributed tools (#22623)	5 years ago
tangwei12	1aab3e61c9	add texttable for pretty flag output (#22584) ... pretty print for communicator flag	5 years ago
tangwei12	b0675c8193	fix bug with compiledProgram (#22495) ... * add thread barrier for the compiled program	5 years ago
yaoxuefeng	2235ee1a5e	multi-loss optimization by adding a DownpourOpt worker (#22025) ... * update * update test=develop * update compile set test=develop * update compile set test=develop * update test=develop * update test=develop * update test=develop * update compile setting test=develop * update compile setting test=develop * update run demo test=develop * update test=develop * update test=develop * fix test=develop * update test=develop * update test=develop * update test=develop * update test=develop * update test=develop * update test=develop * update test=develop * update test=develop * update test=develop * update format test=develop * update format test=develop * update style test=develop * update style test=develop * change style test=develop * change style test=develop * change style test=develop * add dataset unittest test=develop * update test=develop * update for record test=develop * udpate style for record test=develop * update for record test=develop * update for record test=develop * update for record test=develop * fix format test=develop * update test=develop * update test=develop * update test=develop * update test=develop * update test=develop	5 years ago
xujiaqi01	6e4f39a061	add hdfs ls retry time and sleep time, fix save inference (#22433) ... * add hdfs ls retry time and sleep time, fix save inference * test=develop	5 years ago
tangwei12	7e2665c58b	fix bug with half (#22378) ... * fix bug with half communicator	5 years ago
xujiaqi01	371f377bea	add GeneralRoleMaker (#22295) ... * add GeneralRoleMaker which is for general usage * test=develop	5 years ago
tangwei12	82bc814a57	integrated HALF_ASYNC to communicator (#21869) ... * add half_async in the communicator * fix DistributedStrategy	5 years ago
123malin	7fb817d447	add distributed_strategy (#21710) ... * add distributed_strategy	6 years ago
WangXi	3ec289a6a3	fix sync_batch_norm hang in fleet (#21838)	6 years ago
lilong12	da75ac8b6c	bugfix: construct a DistributedStrategy instance if the passed one is None (#21545)	6 years ago
xujiaqi01	f1178e9d79	fix fleet save bug (#21362) ... * fix fleet save bug of save_infernece_model * test=develop	6 years ago
Zhen Wang	be2e3e67d9	Fix some typos in AMP. (#21354) ... * fix some typos in AMP. test=develop * delete useless codes. test=develop	6 years ago
Thunderbrook	9a7832f8be	print table stat info for pslib (#21296) ... * print table stat test=develop * notes test=develop * notes test=develop	6 years ago
xujiaqi01	319d2ba925	fix fs_client_param bug (#21212) ... * fix fs_client_param bug， user can set this config through fleet_desc_file or fleet config * test=develop	6 years ago
Thunderbrook	0d17c1b816	solve pslib core in stop worker (#21263) ... * general table * add sparse table test=develop * no cvm test=develop * add no_cvm test=develop * add note test=develop * code style test=develop * code style test=develop * code style test=develop * code style test=develop * code style test=develop * add key of optimizer test=develop * solve pslib stop core test=develop * barrier test=develop * add notes test=develop	6 years ago
xujiaqi01	eca66f317e	fix fleet util bug (#21254) ... * fix fleet util bug in save paddle inference model * test=develop	6 years ago
Thunderbrook	349e82d669	support general embedding params (#21217) ... * general table * add sparse table test=develop * no cvm test=develop * add no_cvm test=develop * add note test=develop * code style test=develop * code style test=develop * code style test=develop * code style test=develop * code style test=develop * add key of optimizer test=develop	6 years ago
Dong Daxiang	ccbdd7aad0	update worker_num for MPISymetricRoleMaker (#20798) ... test=develop	6 years ago
xujiaqi01	23876de55b	fix cache table bug, add save_paddle_inference_model, fix hdfs util bug (#21052) ... * fix cache table bug * add save_paddle_inference_model * fix hdfs util bug * test=develop	6 years ago
xujiaqi01	9e045170c0	add copy table (#21086) ... * copy some feasigns and corresponding embeddings from one sparse table to another * copy all feasigns and corresponding embeddings from one sparse table to another * copy all dense params from one table to another * copy some local vars to other local vars	6 years ago
lilong12	53148e0696	modify the implementation of save_persistables and save_inference_model for fleet collective mode (#20802) ... * modify the implementation of save_persistables and save_inference_model functions for fleet collective, test=develop * add ut, test=develop	6 years ago