37 Commits (075e1cf78e4104a6c19bd64e593afac00a2f2c21)

Author	SHA1	Message	Date
Thunderbrook	d8396281ef	add slot to sparse table (#18686) ... The change includes 2 things: 1. save delta model and shrink table are control by the same parameter before, now add delete_after_unseen_days to control shrink table. 2. value in sparse table has no slot before, now add slot in sparse table, and add DownpureCtrAccessor to support the new meta. test=develop	7 years ago
jiaqi	d18aabb472	support patch data, add load_one_table, fix bug (#18509) ... （1）support patch data （merge slots of instances of same line id, modify dense layer which changes its size） （2）add fleet load_one_table interface, support load from paddle model and load from pslib model （3）fix push sparse bug which cause push sparse cost more time（about 10% in my testcase） （4）when some slots are not in one of your network (join/update, etc.)，data feed、collect label info、push/pull sparse will skip these slots， instead of throw error. （5）add more debug info in TrainFilesWithProfiler	7 years ago
guru4elephant	357311fdb7	make fleet support mpi job submit directly (#18441) ... make fleet support mpi job submit directly.	7 years ago
tangwei12	999d9a59a5	fix communicator with pyreader (#18350) ... * add is_runnning in communicator, test=develop	7 years ago
tangwei12	4c735f24ea	fix bug in fleet, test=develop (#18058)	7 years ago
tangwei12	101f74cb19	fix save/load in fleet (#17675) ... * fix save/load in Fleet * add UT framework of Fleet	7 years ago
Qiao Longfei	58f7695ab2	Async exe support communicator (#17386) ... Async exe support communicator	7 years ago
jiaqi	05df39ac06	support sparse table get shard_num from TableParameter (#17443) ... test=develop	7 years ago
jiaqi	34369944f5	support config file, cvm, load, save, shrink (#17319) ... * support config file, cvm, load, save, shrink test=develop * fix error of worker_num & add table.compress_in_save test=develop * fix code style test=develop * fix save model bug test=develop	7 years ago
tangwei12	565d309501	Reformat fleet API (#17135) ... * fix some logic in distributed transpiler, test=develop * reformat fleet API, test=develop	7 years ago
tangwei12	1a4a51db2b	Fleet unify distributed training (#16791) ... * implement distributed transpiler with fleet	7 years ago
jiaqi	7968887fae	Merge branch 'develop' into dataset_merge_develop	7 years ago
dongdaxiang	ceac9df87a	fix code style for incubator	7 years ago
xjqbest	e784884e70	add Example in doc string of split_filelist ... test=develop	7 years ago
xjqbest	1c0ef929f9	fix code style ... test=develop	7 years ago
xujiaqi01	1938132936	fix code style ... test=develop	7 years ago
xjqbest	d5ee580c5c	move split filelist from trainer.py to fleet & fix error ... test=develop	7 years ago
xjqbest	126d2a2f9d	fix init_worker bug ... test=develop	7 years ago
xjqbest	7a759d76cd	fix code style ... test=develop	7 years ago
xjqbest	5e5139283b	fix runtime error ... test=develop	7 years ago
xjqbest	a99c8d0c29	fix client to client communication bug ... test=develop	7 years ago
xjqbest	a38b98cb32	fix code style & runtime error ... test=develop	7 years ago
dongdaxiang	17790188d0	make role maker and distributed optimizer private	7 years ago
xjqbest	d52586a97d	add doc string ... test=develop	7 years ago
xjqbest	b7940c2918	fix bug of gen_worker_desc and set_filelist, add some doc	7 years ago
xujiaqi01	20b76f3deb	init model support multi programs	7 years ago
xujiaqi01	f5c6a14b54	fix runtime error	7 years ago
xujiaqi01	a5b1a0e12b	support multi dataset && add init model && fix bug	7 years ago
dongdaxiang	3c65cc1bbd	add document for role_maker and fleet parameter, data_generator	7 years ago
dongdaxiang	a58df687a8	only allow fleet to be initialized once	7 years ago
dongdaxiang	3e38d1db46	add trainfileswithprofiler for downpour worker	7 years ago
dongdaxiang	2644b88685	add comment for MPI Symetric role maker ... test=develop	7 years ago
dongdaxiang	b7a202aa38	add distributed optimizer factory	7 years ago
dongdaxiang	fd3adf58a3	add distributed optimizer factory	7 years ago
dongdaxiang	f612877797	add incubate for unified API	7 years ago
dongdaxiang	317eb0aad3	add incubate for unified API	7 years ago
dongdaxiang	3641a78b01	add incubate for unified API	7 years ago