Paddle

Commit Graph

Author	SHA1	Message	Date
Thunderbrook	4adddcc89a	add set_trainer_num api in dataset (#29133 )	5 years ago
wawltor	ff8922f9f2	fix the dataset remove bug for the dataset fix the dataset remove bug for the dataset	5 years ago
yaoxuefeng	780140599f	【paddle.distributed.fleet】add data_generator in distributed.fleet.dataset (#27345 )	5 years ago
yaoxuefeng	c67c391682	refine fleet dataset class api (#27133 )	5 years ago
Dong Daxiang	50a5bcfc9d	【paddle.fleet】paddle.fleet -> paddle.distributed.fleet. (#26186 ) * move paddle.fleet to paddle.distributed.fleet	5 years ago
xujiaqi01	20c8432ae3	move dataset from paddfle.fluid to paddle.fleet (#25887 ) * move dataset to fleet test=develop * fix test=develop * fix test=develop * fix test=develop * test=develop * test=develop * test=develop * test=develop * test=develop * test=develop * test=develop	5 years ago
tangwei12	caa90a6510	Integrated Trainer of Parameter Server (API add `fluid.contrib.layers.sparse_embedding` only) (#22957 ) * Integrated Trainer of Parameter Server	5 years ago
hutuxian	e6b87b3193	Support AucRunner in PaddleBox (#22884 ) * Support AucRunner in PaddleBox * update some code style	5 years ago
wawltor	d1e1d85881	add the graph batch reader for pslib mode (#24178 ) Add the pslib graph batch reader mode, add the test case for this change	5 years ago
tangwei12	c4a6a0e2e4	Revert "Integrated API of Parameter Server (#22710 )" test=develop (#23071 ) This reverts commit `66fce9e824`.	5 years ago
tangwei12	66fce9e824	Integrated API of Parameter Server (#22710 ) Fleet Parameter Server API Integrated	5 years ago
hutuxian	53a2b68f4e	support customized download command in dataset (#22782 ) * user can call dataset.set_download_cmd to set its customized download cmd * add UT to cover this scenario	5 years ago
yaoxuefeng	2235ee1a5e	multi-loss optimization by adding a DownpourOpt worker (#22025 ) * update * update test=develop * update compile set test=develop * update compile set test=develop * update test=develop * update test=develop * update test=develop * update compile setting test=develop * update compile setting test=develop * update run demo test=develop * update test=develop * update test=develop * fix test=develop * update test=develop * update test=develop * update test=develop * update test=develop * update test=develop * update test=develop * update test=develop * update test=develop * update test=develop * update format test=develop * update format test=develop * update style test=develop * update style test=develop * change style test=develop * change style test=develop * change style test=develop * add dataset unittest test=develop * update test=develop * update for record test=develop * udpate style for record test=develop * update for record test=develop * update for record test=develop * update for record test=develop * fix format test=develop * update test=develop * update test=develop * update test=develop * update test=develop * update test=develop	5 years ago
xujiaqi01	371f377bea	add GeneralRoleMaker (#22295 ) * add GeneralRoleMaker which is for general usage * test=develop	5 years ago
xujiaqi01	f404157205	fix master patch when slot is dense (#21580 ) * fix master patch when slot is dense * test=develop	6 years ago
xujiaqi01	319d2ba925	fix fs_client_param bug (#21212 ) * fix fs_client_param bug， user can set this config through fleet_desc_file or fleet config * test=develop	6 years ago
xujiaqi01	23876de55b	fix cache table bug, add save_paddle_inference_model, fix hdfs util bug (#21052 ) * fix cache table bug * add save_paddle_inference_model * fix hdfs util bug * test=develop	6 years ago
xujiaqi01	1d1a07937a	simplify master+patch，remove ins when size != merge_size or has conflict slot (#20913 ) * remove duplicate code and duplicate config of master+patch * drop all ins which has conflict slot or size < merge_size * user only need to set merge size，if ins num of same id is not equal to merge size, just drop these ins * user must make sure master data and patch data has no same slot whose feasigns are both non-zero, otherwise these ins will be dropped. (slot list should still be the same of both master and patch) * test=develop	6 years ago
tangwei12	c9139c3db3	trainer from dataset fetch targets (#19760 ) add executor.FetchHandler for train/infer from the dataset	6 years ago
xujiaqi01	cedc04775c	support change shuffle and train thread num (#19841 ) * support change shuffle thread num * support change train thread num * fix receive shuffle data of each channel * data norm stop gradient * add check thread_tensor type and root_tensor type when merge metric * remove sleep in shuffle, add config * add config of pslib client to client communication * fix xbox str * add data norm op testcase * add flush in trainer finalize	6 years ago
Zeng Jinle	0436efd6a3	Unify DataLoader APIs (#19305 ) * unify DataLoader APIs, test=develop * integrate iterable CPU Dataset, test=develop add GPU dataset supporting, test=develop * add unittests for dataset, test=develop * add more docs to dataloader apis, test=develop, test=document_preview * refine doc, test=develop * refine doc again, test=develop * increase coverage, test=develop	6 years ago
xujiaqi01	6bf298bf09	support preload thread, optimize hdfs log, fix master+patch bug (#19695 ) * support preload thread * sleep before fleet wrapper exit for pslib core dump * optimize hdfs log * fix master+patch bug	6 years ago
Thunderbrook	1fe468d319	support debug each output of each ins (#19004 ) * dump slot * test * proto * dump slot * test * proto * code style * code style * code style * style * add delete after unseen days * add unseen days * code style * conflict solve test=develop * add clear model * code style test=develop * code style test=develop * support debug tensor of each ins test=develop * support debug tensor of each ins test=develop * learning rate * code style * code style * code style * code style * code style * code style * code style * code style * code style * code style * code style * code style * code style test=develop * code style test=develop * unitest * style * style * multi phase * add channel * code style * style * style * unitest * style * define * define test=develop * style test=develop * rm define test=develop * linux * linux test=develop * style test=develop * output format test=develop * windows ci test=develop	6 years ago
yaoxuefeng	9150cf50fc	add save cache model api in fleet& add slots shuffle in dataset module & add metric op to calculate ctr related metrics (#18871 ) * add ctr related metric layer test=develop * add save cache and slots shuffle test=develop * add save cache and slots shuffle test=develop * fix error * fix error * fix style for ci * fix for comments * change SlotsShuffle input to std::strinf for generality * fix style * fix style * fix style * fix style * fix style * fix style * fix stylr * fix style * fix style * fix style * fix style * fix style * fix style * fix style * fix style * fix style * fix style * fix style * fix style * fix style * change non-const reference to pointer * fix style * fix style * fix style test=develop * fix style test=develop * add return ins num in ctr metric op * change dtype to float in metric_op.py * fix error test=develop * fix style test=develop * fix API spec * fix API spec * fix API spec test=develop * add UT test=develop	6 years ago
hutuxian	5a80cc8431	Datafeed support reading to cuda place directly. (#19071 ) * add a place field in DataFeed to denote which place it will feed data to. * abstract the copy process in CopyToFeedTensor function * add UT for float32 type and for CUDAPlace	6 years ago
hutuxian	6e0df3102e	Refactor for Pipeline Thread Check (#18459 ) move the thread-check code from train_from_dataset to a single function add UT for the thread check function	6 years ago
xjqbest	274477005e	fix dataset testcase error test=develop	6 years ago
xjqbest	5e5139283b	fix runtime error test=develop	6 years ago
xjqbest	271b7147cc	fix dataset bug test=develop	6 years ago
xjqbest	a99c8d0c29	fix client to client communication bug test=develop	6 years ago
dongdaxiang	720647e17f	rebase current develop and fix conflict test=develop	6 years ago
dongdaxiang	93c3c7f9b3	fix dataset testcase problem test=develop	6 years ago
xjqbest	1497ce388d	fix code style of test_dataset.py test=develop	6 years ago
xjqbest	7cdd57a474	fix code style of test_dataset.py test=develop	6 years ago
xjqbest	748d54cb46	fix code style of test_dataset.py test=develop	6 years ago
xjqbest	1073b4d8f9	fix code style of test_dataset.py test=develop	6 years ago
dongdaxiang	45eb6f0765	run pre-commit check files and fix code style problem test=develop	6 years ago
xjqbest	e57ac5ed17	fix code style test=develop	6 years ago
xjqbest	97c74e60c3	fix code style test=develop	6 years ago
xjqbest	a38b98cb32	fix code style & runtime error test=develop	6 years ago
xjqbest	d52586a97d	add doc string test=develop	6 years ago
xjqbest	e95cafd9a7	fix code style & add dataset testcase test=develop	6 years ago

42 Commits (4adddcc89ad2b2e57faabe5734bae47e2f44111a)