10 Commits (1840c1652c1a67043884e3cdd0b5c39a05c9474d)

Author	SHA1	Message	Date
xujiaqi01	6bf298bf09	support preload thread, optimize hdfs log, fix master+patch bug (#19695) ... * support preload thread * sleep before fleet wrapper exit for pslib core dump * optimize hdfs log * fix master+patch bug	5 years ago
jiaqi	02c370c3dc	support filelist size < trainer num && fix pull dense (#18956) ... * support filelist size < trainer num * pull dense when stop, to make sure local dense params are same as pserver, so save paddle model will save dense model same as pserver * enable QueueDataset train same filelist for serveral times	6 years ago
jiaqi	66d51206b1	add save/load model, shrink table, cvm, config file & fix pull dense bug (#17118) ... * add save/load model, shrink table, cvm, config file & fix pull dense bug test=develop * fix global shuffle bug, fix pull dense bug, fix release memeory bug, fix shrink error add client flush, add get data size test=develop * fix global shuffle bug test=develop * fix global shuffle bug test=develop * fix code style test=develop * fix code style & modify pslib cmake test=develop * fix error of _role_maker test=develop * fix code style test=develop * fix code style test=develop * fix code style test=develop * fix code style test=develop * fix code style test=develop * fix windows compile error of fleet test=develop * fix global shuffle bug * add comment test=develop * update pslib.cmake test=develop * fix fill sparse bug test=develop * fix push sparse bug test=develop	6 years ago
dongdaxiang	f7e4813804	add WIN32 for rand_r and usleep ... test=develop	6 years ago
dongdaxiang	45eb6f0765	run pre-commit check files and fix code style problem ... test=develop	6 years ago
heqiaozhi	9bca1926c1	refactor & fix bug	6 years ago
dongdaxiang	97d5cd30f0	make pull dense worker work	6 years ago
dongdaxiang	378037c535	make s_instance_ private to ensure singleton	6 years ago
dongdaxiang	c165012031	refine device_worker and trainer code ... test=develop	6 years ago
dongdaxiang	855bf579d2	add dist_multi_trainer for distributed training, add trainer_factory and device_worker_factory so that we can easily extend new training mode, add pull dense worker which is a singleton for parameter fetching	6 years ago