121 Commits (995a6376f784f4cda347b433c79def44c59c9783)

Author	SHA1	Message	Date
yaoxuefeng	995a6376f7	add pslib SparseDoubleTable test=develop (#23053)	5 years ago
tangwei12	c4a6a0e2e4	Revert "Integrated API of Parameter Server (#22710)" test=develop (#23071) ... This reverts commit 66fce9e824.	5 years ago
tangwei12	66fce9e824	Integrated API of Parameter Server (#22710) ... Fleet Parameter Server API Integrated	5 years ago
yaoxuefeng	c5cbe7f07b	fix add grad bug test=develop (#22924) ... * fix add grad bug test=develop * update style test=develop	5 years ago
123malin	0f9d40816e	test=develop, optimize distributedstrategy (#22677) ... * test=develop, optimize distributedstrategy	5 years ago
tianshuo78520a	433cef03e5	fix typo word (#22784)	5 years ago
tianshuo78520a	d2ba91aad1	fix typo words (#22653)	5 years ago
tangwei12	66a3150135	SYNC with communicaotor (#22344) ... * add sync communicator and implement	5 years ago
123malin	00594c1c88	support dumping params/grads in transpiler mode (#22490)	5 years ago
123malin	e59463efc7	test=develop, add distributed tools (#22623)	5 years ago
tangwei12	1aab3e61c9	add texttable for pretty flag output (#22584) ... pretty print for communicator flag	5 years ago
tangwei12	b0675c8193	fix bug with compiledProgram (#22495) ... * add thread barrier for the compiled program	5 years ago
yaoxuefeng	2235ee1a5e	multi-loss optimization by adding a DownpourOpt worker (#22025) ... * update * update test=develop * update compile set test=develop * update compile set test=develop * update test=develop * update test=develop * update test=develop * update compile setting test=develop * update compile setting test=develop * update run demo test=develop * update test=develop * update test=develop * fix test=develop * update test=develop * update test=develop * update test=develop * update test=develop * update test=develop * update test=develop * update test=develop * update test=develop * update test=develop * update format test=develop * update format test=develop * update style test=develop * update style test=develop * change style test=develop * change style test=develop * change style test=develop * add dataset unittest test=develop * update test=develop * update for record test=develop * udpate style for record test=develop * update for record test=develop * update for record test=develop * update for record test=develop * fix format test=develop * update test=develop * update test=develop * update test=develop * update test=develop * update test=develop	5 years ago
xujiaqi01	6e4f39a061	add hdfs ls retry time and sleep time, fix save inference (#22433) ... * add hdfs ls retry time and sleep time, fix save inference * test=develop	5 years ago
tangwei12	7e2665c58b	fix bug with half (#22378) ... * fix bug with half communicator	5 years ago
xujiaqi01	371f377bea	add GeneralRoleMaker (#22295) ... * add GeneralRoleMaker which is for general usage * test=develop	5 years ago
tangwei12	82bc814a57	integrated HALF_ASYNC to communicator (#21869) ... * add half_async in the communicator * fix DistributedStrategy	5 years ago
123malin	7fb817d447	add distributed_strategy (#21710) ... * add distributed_strategy	5 years ago
WangXi	3ec289a6a3	fix sync_batch_norm hang in fleet (#21838)	5 years ago
lilong12	da75ac8b6c	bugfix: construct a DistributedStrategy instance if the passed one is None (#21545)	6 years ago
xujiaqi01	f1178e9d79	fix fleet save bug (#21362) ... * fix fleet save bug of save_infernece_model * test=develop	6 years ago
Zhen Wang	be2e3e67d9	Fix some typos in AMP. (#21354) ... * fix some typos in AMP. test=develop * delete useless codes. test=develop	6 years ago
Thunderbrook	9a7832f8be	print table stat info for pslib (#21296) ... * print table stat test=develop * notes test=develop * notes test=develop	6 years ago
xujiaqi01	319d2ba925	fix fs_client_param bug (#21212) ... * fix fs_client_param bug， user can set this config through fleet_desc_file or fleet config * test=develop	6 years ago
Thunderbrook	0d17c1b816	solve pslib core in stop worker (#21263) ... * general table * add sparse table test=develop * no cvm test=develop * add no_cvm test=develop * add note test=develop * code style test=develop * code style test=develop * code style test=develop * code style test=develop * code style test=develop * add key of optimizer test=develop * solve pslib stop core test=develop * barrier test=develop * add notes test=develop	6 years ago
xujiaqi01	eca66f317e	fix fleet util bug (#21254) ... * fix fleet util bug in save paddle inference model * test=develop	6 years ago
Thunderbrook	349e82d669	support general embedding params (#21217) ... * general table * add sparse table test=develop * no cvm test=develop * add no_cvm test=develop * add note test=develop * code style test=develop * code style test=develop * code style test=develop * code style test=develop * code style test=develop * add key of optimizer test=develop	6 years ago
Dong Daxiang	ccbdd7aad0	update worker_num for MPISymetricRoleMaker (#20798) ... test=develop	6 years ago
xujiaqi01	23876de55b	fix cache table bug, add save_paddle_inference_model, fix hdfs util bug (#21052) ... * fix cache table bug * add save_paddle_inference_model * fix hdfs util bug * test=develop	6 years ago
xujiaqi01	9e045170c0	add copy table (#21086) ... * copy some feasigns and corresponding embeddings from one sparse table to another * copy all feasigns and corresponding embeddings from one sparse table to another * copy all dense params from one table to another * copy some local vars to other local vars	6 years ago
lilong12	53148e0696	modify the implementation of save_persistables and save_inference_model for fleet collective mode (#20802) ... * modify the implementation of save_persistables and save_inference_model functions for fleet collective, test=develop * add ut, test=develop	6 years ago
Thunderbrook	5970e8ac5e	find lookup table in order (#20932) ... test=develop	6 years ago
Chengmo	16596f6498	Fix Paddle Cloud role maker (#20860) ... * fix PaddleCloud Role maker & add warning in distribute transpiler & change rpc_retry_times	6 years ago
Bai Yifan	ac87d4e6e1	fix hdfs.download, test=develop (#20907)	6 years ago
Thunderbrook	59bcdc8a19	support dump param of model into afs (#20302) ... * support dump param to afs test=develop * code style test=develop * code style test=develop * dump param test=develop * dump param test=develop * dump param test=develop * dump param test=develop	6 years ago
xujiaqi01	48669aa8f0	fix several sparse table issuses (#20686) ... * no longer need to define all embedding layers (no one less) of all slots in each program. make trainer_param repeated in ps.proto. * add find_distributed_lookup_table_grads instead of hard code GRAD * support embedding stop gradient. push sparse has error before fix this.* * fix fill sparse, skip slots which do not have embedding. each slot's embedding in a sparse table should be used in all training programs before fix this. * fix pull sparse, skip slots which do not have embedding. * fix collect feasign label info, skip slots which do not have embedding. * support when there are multi sparse tables in one or multi training programs, each program can pull/push its own related sparse tables instead of all sparse tables. * test=develop	6 years ago
xujiaqi01	5223b0dd9d	add check nan / inf in downpour worker (#20694) ... * add check nan / inf in downpour worker during training * test=develop	6 years ago
Chengmo	940c6ff1c8	Fix communicator slow bug & fix communicator stop bug (#20366) ... * test=develop,Fix communicator slow bug * test=develop, delete if() in stop_worker() * test=develop * fix UT, test=develop * fix bug in fetch handler, test=develop * fix bug in fetch handler, test=develop * test=develop, fix fetch barrier bug * test=develop, bug fix * test=develop, bug fix * test=develop, fix bug	6 years ago
WangXi	cadc6a9704	fix dgc test and bug when not set trainers_endpoints_, test=develop (#20617)	6 years ago
mapingshuo	f55d1c6867	Fleet: deal with special case: strategy is None (#20359) ... * special case: strategy is None	6 years ago
Thunderbrook	f76a32df4a	dump fix dov vec file num (#20539) ... * support dump multi file test=develop * dump fix num file test=develop	6 years ago
zhang wenhui	b521992041	fix converter , test=develop (#20522)	6 years ago
zhang wenhui	b82e6520e1	fix pslib datanorm double bug (#20297) ... * fix fc sort . test=develop	6 years ago
zhang wenhui	b28d4a824f	fix fleet_desc delete_after_unseen_day bug in node.py (#20091)	6 years ago
Chengmo	728ec1b43d	Add GEO-SGD distribute training algorithm (#20018) ... * refector geo sgd & communicator	6 years ago
xujiaqi01	cedc04775c	support change shuffle and train thread num (#19841) ... * support change shuffle thread num * support change train thread num * fix receive shuffle data of each channel * data norm stop gradient * add check thread_tensor type and root_tensor type when merge metric * remove sleep in shuffle, add config * add config of pslib client to client communication * fix xbox str * add data norm op testcase * add flush in trainer finalize	6 years ago
mapingshuo	9901f69677	Forward recompute3 (#19913) ... * add recompute based checkpoints methods for large batch training test=develop * add append_backward_with_forward_recomputation test=develop * refine optimizer test=develop * update backward and optimizer test=develop * make Variable usable test=develop * add recompute code * refine optimizer test=develop * refine addup _append_backward_ops_with_checkpoints_ 1) for recompute part, just cache the grad_op_desc without appending to block 2) before appending grad_op_desc to backward part, addup_repetitive_vars, remove unused branch test=develop * make method private * add recompute strategy into DistributedStrategy test=develop * checkpoint version3 test=develop * remove some print information test=develop * remove unused sumop test=develop * try to fix recompute with graph building modules * add input names to vars should be held * add memory debug tool * backup backward * Fix bugs * add backward desc for op not in any segments * add exception info for sub_block test=develop * modify code style test=develop * modify code style test=develop * remove print functions test=develop * add API spec test=develop test=document_preview * make Recompute a child class of Optimizer test=develop test=document_preview * add API spec test=develop test=document_preview * modify API spec test=develop test=document_preview * add document for Recompute test=develop test=document_preview * change API doc of Rcompute test=develop test=document_preview * code cleaning test=develop test=document_preview * modify API spec * fix bugs when segments hold no element * add testcase for Recompute Optimizer test=develop test=document_preview * add test for apply_gradient, and code cleaning test=develop test=document_preview * add test case for load function * enable CI test=develop test=document * add test case test=develop test=document_preview * add sample code for 4 function of recompute optimizer test=develop test=document_preview	6 years ago
tangwei12	278dd00322	paddle cloud role maker fix (#19646) ... * optimize cloud rolemaker, test=develop	6 years ago
gongweibao	e8d3745c0f	change _origin_program test=develop (#19863) ... change _origin_program test=develop	6 years ago
xujiaqi01	6bf298bf09	support preload thread, optimize hdfs log, fix master+patch bug (#19695) ... * support preload thread * sleep before fleet wrapper exit for pslib core dump * optimize hdfs log * fix master+patch bug	6 years ago