126 Commits (24a063f6ac0ba1122b5b6bec524c6ec659197e5f)

Author	SHA1	Message	Date
gongweibao	24a063f6ac	Add fleet checkpoint on local fs and remote fs(such as hdfs) for EDL (#22586)	5 years ago
xujiaqi01	21f59779ea	fix dump slot in strategy (#23398)	5 years ago
xujiaqi01	3a45767d49	add fleet pslib pull and push sparse op and push dense op (#23139) ... * add fleet pslib pull and push sparse op and push dense op * test=develop	5 years ago
xujiaqi01	c8f9e66b71	fix no_cvm in config_fleet (#22818) ... * fix no cvm, when accessor is DownpourSparseValueAccessor, set no_cvm=True * test=develop	5 years ago
xujiaqi01	68ea1ad55b	add clear one table (#23089) ... * add clear_one_table * test=develop	5 years ago
yaoxuefeng	995a6376f7	add pslib SparseDoubleTable test=develop (#23053)	5 years ago
tangwei12	c4a6a0e2e4	Revert "Integrated API of Parameter Server (#22710)" test=develop (#23071) ... This reverts commit 66fce9e824.	5 years ago
tangwei12	66fce9e824	Integrated API of Parameter Server (#22710) ... Fleet Parameter Server API Integrated	5 years ago
yaoxuefeng	c5cbe7f07b	fix add grad bug test=develop (#22924) ... * fix add grad bug test=develop * update style test=develop	5 years ago
123malin	0f9d40816e	test=develop, optimize distributedstrategy (#22677) ... * test=develop, optimize distributedstrategy	5 years ago
tianshuo78520a	433cef03e5	fix typo word (#22784)	5 years ago
tianshuo78520a	d2ba91aad1	fix typo words (#22653)	5 years ago
tangwei12	66a3150135	SYNC with communicaotor (#22344) ... * add sync communicator and implement	5 years ago
123malin	00594c1c88	support dumping params/grads in transpiler mode (#22490)	5 years ago
123malin	e59463efc7	test=develop, add distributed tools (#22623)	5 years ago
tangwei12	1aab3e61c9	add texttable for pretty flag output (#22584) ... pretty print for communicator flag	5 years ago
tangwei12	b0675c8193	fix bug with compiledProgram (#22495) ... * add thread barrier for the compiled program	5 years ago
yaoxuefeng	2235ee1a5e	multi-loss optimization by adding a DownpourOpt worker (#22025) ... * update * update test=develop * update compile set test=develop * update compile set test=develop * update test=develop * update test=develop * update test=develop * update compile setting test=develop * update compile setting test=develop * update run demo test=develop * update test=develop * update test=develop * fix test=develop * update test=develop * update test=develop * update test=develop * update test=develop * update test=develop * update test=develop * update test=develop * update test=develop * update test=develop * update format test=develop * update format test=develop * update style test=develop * update style test=develop * change style test=develop * change style test=develop * change style test=develop * add dataset unittest test=develop * update test=develop * update for record test=develop * udpate style for record test=develop * update for record test=develop * update for record test=develop * update for record test=develop * fix format test=develop * update test=develop * update test=develop * update test=develop * update test=develop * update test=develop	5 years ago
xujiaqi01	6e4f39a061	add hdfs ls retry time and sleep time, fix save inference (#22433) ... * add hdfs ls retry time and sleep time, fix save inference * test=develop	5 years ago
tangwei12	7e2665c58b	fix bug with half (#22378) ... * fix bug with half communicator	5 years ago
xujiaqi01	371f377bea	add GeneralRoleMaker (#22295) ... * add GeneralRoleMaker which is for general usage * test=develop	5 years ago
tangwei12	82bc814a57	integrated HALF_ASYNC to communicator (#21869) ... * add half_async in the communicator * fix DistributedStrategy	5 years ago
123malin	7fb817d447	add distributed_strategy (#21710) ... * add distributed_strategy	5 years ago
WangXi	3ec289a6a3	fix sync_batch_norm hang in fleet (#21838)	5 years ago
lilong12	da75ac8b6c	bugfix: construct a DistributedStrategy instance if the passed one is None (#21545)	5 years ago
xujiaqi01	f1178e9d79	fix fleet save bug (#21362) ... * fix fleet save bug of save_infernece_model * test=develop	5 years ago
Zhen Wang	be2e3e67d9	Fix some typos in AMP. (#21354) ... * fix some typos in AMP. test=develop * delete useless codes. test=develop	5 years ago
Thunderbrook	9a7832f8be	print table stat info for pslib (#21296) ... * print table stat test=develop * notes test=develop * notes test=develop	5 years ago
xujiaqi01	319d2ba925	fix fs_client_param bug (#21212) ... * fix fs_client_param bug， user can set this config through fleet_desc_file or fleet config * test=develop	5 years ago
Thunderbrook	0d17c1b816	solve pslib core in stop worker (#21263) ... * general table * add sparse table test=develop * no cvm test=develop * add no_cvm test=develop * add note test=develop * code style test=develop * code style test=develop * code style test=develop * code style test=develop * code style test=develop * add key of optimizer test=develop * solve pslib stop core test=develop * barrier test=develop * add notes test=develop	5 years ago
xujiaqi01	eca66f317e	fix fleet util bug (#21254) ... * fix fleet util bug in save paddle inference model * test=develop	5 years ago
Thunderbrook	349e82d669	support general embedding params (#21217) ... * general table * add sparse table test=develop * no cvm test=develop * add no_cvm test=develop * add note test=develop * code style test=develop * code style test=develop * code style test=develop * code style test=develop * code style test=develop * add key of optimizer test=develop	5 years ago
Dong Daxiang	ccbdd7aad0	update worker_num for MPISymetricRoleMaker (#20798) ... test=develop	5 years ago
xujiaqi01	23876de55b	fix cache table bug, add save_paddle_inference_model, fix hdfs util bug (#21052) ... * fix cache table bug * add save_paddle_inference_model * fix hdfs util bug * test=develop	5 years ago
xujiaqi01	9e045170c0	add copy table (#21086) ... * copy some feasigns and corresponding embeddings from one sparse table to another * copy all feasigns and corresponding embeddings from one sparse table to another * copy all dense params from one table to another * copy some local vars to other local vars	5 years ago
lilong12	53148e0696	modify the implementation of save_persistables and save_inference_model for fleet collective mode (#20802) ... * modify the implementation of save_persistables and save_inference_model functions for fleet collective, test=develop * add ut, test=develop	5 years ago
Thunderbrook	5970e8ac5e	find lookup table in order (#20932) ... test=develop	5 years ago
Chengmo	16596f6498	Fix Paddle Cloud role maker (#20860) ... * fix PaddleCloud Role maker & add warning in distribute transpiler & change rpc_retry_times	5 years ago
Bai Yifan	ac87d4e6e1	fix hdfs.download, test=develop (#20907)	5 years ago
Thunderbrook	59bcdc8a19	support dump param of model into afs (#20302) ... * support dump param to afs test=develop * code style test=develop * code style test=develop * dump param test=develop * dump param test=develop * dump param test=develop * dump param test=develop	5 years ago
xujiaqi01	48669aa8f0	fix several sparse table issuses (#20686) ... * no longer need to define all embedding layers (no one less) of all slots in each program. make trainer_param repeated in ps.proto. * add find_distributed_lookup_table_grads instead of hard code GRAD * support embedding stop gradient. push sparse has error before fix this.* * fix fill sparse, skip slots which do not have embedding. each slot's embedding in a sparse table should be used in all training programs before fix this. * fix pull sparse, skip slots which do not have embedding. * fix collect feasign label info, skip slots which do not have embedding. * support when there are multi sparse tables in one or multi training programs, each program can pull/push its own related sparse tables instead of all sparse tables. * test=develop	5 years ago
xujiaqi01	5223b0dd9d	add check nan / inf in downpour worker (#20694) ... * add check nan / inf in downpour worker during training * test=develop	5 years ago
Chengmo	940c6ff1c8	Fix communicator slow bug & fix communicator stop bug (#20366) ... * test=develop,Fix communicator slow bug * test=develop, delete if() in stop_worker() * test=develop * fix UT, test=develop * fix bug in fetch handler, test=develop * fix bug in fetch handler, test=develop * test=develop, fix fetch barrier bug * test=develop, bug fix * test=develop, bug fix * test=develop, fix bug	5 years ago
WangXi	cadc6a9704	fix dgc test and bug when not set trainers_endpoints_, test=develop (#20617)	5 years ago
mapingshuo	f55d1c6867	Fleet: deal with special case: strategy is None (#20359) ... * special case: strategy is None	5 years ago
Thunderbrook	f76a32df4a	dump fix dov vec file num (#20539) ... * support dump multi file test=develop * dump fix num file test=develop	5 years ago
zhang wenhui	b521992041	fix converter , test=develop (#20522)	5 years ago
zhang wenhui	b82e6520e1	fix pslib datanorm double bug (#20297) ... * fix fc sort . test=develop	5 years ago
zhang wenhui	b28d4a824f	fix fleet_desc delete_after_unseen_day bug in node.py (#20091)	5 years ago
Chengmo	728ec1b43d	Add GEO-SGD distribute training algorithm (#20018) ... * refector geo sgd & communicator	5 years ago