105 Commits (8c19d7aa2f89a38b3a68e53c73d88af16a3de8ce)

Author	SHA1	Message	Date
Thunderbrook	3789a69923	solve bug in heter mode (#31531) ... * heter bug * format * format	4 years ago
Qi Li	65bcaeb004	[ROCM] update fluid operators for rocm (part5), test=develop (#31258) ... * [ROCM] update fluid operators for rocm (part5), test=develop * address review comments, test=develop * fix typo, test=develop	4 years ago
danleifeng	d1075df2e8	topo and memory performance for heterps (#30440) ... * topo and memory performance for heterps; test=develop * add trainwithprofiler in heter trainier; test=develop	4 years ago
Thunderbrook	c4f279fe8d	support multi node in heterps (#31102) ... * push multi node * multi node * MultiThread * remove log * solve bug in 30829	4 years ago
Qi Li	a60d93fb77	[ROCM] update fluid framework for rocm (part2), test=develop (#31010)	4 years ago
Thunderbrook	565354f676	support save multi sparse table in one path (#31108) ... * save multi table one path * format	4 years ago
Qi Li	8fe09faf14	[ROCM] update fluid framework for rocm (part1), test=develop (#31009)	4 years ago
wanghuancoder	35c5b23f68	use iwyu clean include second time, test=develop (#30829) ... * use iwyu clean include second time, test=develop	4 years ago
Thunderbrook	cb66c53c2d	dump to cpu (#30750) ... * dump to cpu * format * format * format	4 years ago
Thunderbrook	1bebc09253	solve build gpu task core (#30626) ... * build gpu task core * format	4 years ago
Leo Chen	81217a94d8	unify calling cudaSetDevice (#30470) ... * unify calling cudaSetDevice * fix compile	4 years ago
hutuxian	40ede12631	Ascend Framework Part1: OP & Wrapper (#30281)	4 years ago
yaoxuefeng	6e0da01c61	Heter ps new (#30198)	4 years ago
tangwei12	5e839e4da5	add sparse embedding & load vars for 2.0 & gloo bug fix (#30306) ... * add sparse embedding & load vars for 2.0 Change-Id: I36b59ed5f015189dc9d9d2e34a9357722d369f1b * fix hdfs gloo Change-Id: Ia84d579053720ad804183e54c9a04b4f031c79c6 * fix gloo hdfs Change-Id: I5ab982fd483cddc10adcdef0b8aa83aca976cb9e * move loadvar/sparse embedding from incubute to static Change-Id: I57081d3545ad2efab78c72420d2162c0eacaf3a0	4 years ago
Thunderbrook	0b8e1fadc5	add topo-aware in heter-ps (#30087) ... * add topo aware * resource.h * topo aware * format	4 years ago
Thunderbrook	0ca6de171f	add include (#29952)	4 years ago
YUNSHEN XIE	2a01756bf3	remove duplicate ut names (#29809)	4 years ago
Thunderbrook	09b6e71928	heter box (#29734) ... * 　add heter box * add trainer, worker, wrapper... * format * for ci * format * remove boost get * boost & copyright * rename * 　rename * format * format * format Co-authored-by: yaoxuefeng6 <yaoxuefeng@baidu.com>	4 years ago
lilong12	ff6a145011	update, test=develop (#29559)	4 years ago
Thunderbrook	0073f9bdb0	support ps-gpu (#28752) ... * ps gpu transpile * ps gpu * remove op * gps trainer * local ps * add macro * HeterBox * def cuda * tab * code style * style Co-authored-by: Thunderbrook <a754913769#163.com>	4 years ago
wanghuancoder	41aad9bfcd	revert 4 files, from clear include by iwyu, test=develop (#27895)	4 years ago
Thunderbrook	6f69a4cb05	add xpu in heter mode (#27000) ... * add xpu in heter mode test=develop * BOOST_CONST_GET; PADDLE_THROW test=develop * code style test=develop * code style test=develop * code style test=develop * refine test=develop * refine test=develop * refine test=develop * refine code test=develop	4 years ago
wanghuancoder	df43905f12	use iwyu clean include (#27267) ... * use iwyu clean include, test=develop, test=win * compilation error, test=develop * fix compilation error2, test=develop * fix compilation error3, test=develop * fix compilation error4, test=develop * fix compilation error5, test=develop * fix compilation error6, test=develop * fix compilation error7, test=develop * fix compilation error8, test=develop * fix compilation error8, test=develop * fix compilation error10, test=develop * fix compilation error11, test=develop	4 years ago
tangwei12	99626502f7	【paddle.fleet】gloo and util (#27213) ... * fix worker endpoints * fix gloo wrapper for hdfs * GPU fleetrun support gloo * parameterserver fleetrun support gloo * fix get server endpoint	4 years ago
Chen Weihang	79149c8ee6	polish framework error message part 8 (#27269)	4 years ago
Thunderbrook	5205748481	fix eigen in push sparse; fix hadoop command (#26872) ... * fix eigen in push sparse; fix hadoop command test=develop * add log in load_combine_op test=develop	5 years ago
yaoxuefeng	a47d92d868	fleet add save with whitelist test=develop (#23376)	5 years ago
lilong12	1c68138327	[api 2.0] add collective op for cpu using gloo and paddle.distributed.* apis (#26552) ... add collective op for cpu using gloo and paddle.distributed.* apis	5 years ago
Thunderbrook	a83e0f264c	fix heter proto (#26093) ... test=develop	5 years ago
Thunderbrook	fd2947babf	fix compile error with mkl (#26030) ... test=develop	5 years ago
123malin	2191a08317	【paddle.fleet】fleet_util move to paddle.fleet (#25805) ... * test=develop,test=document_fix, remove the out args * fleet_util move to paddle.fleet Co-authored-by: WuHaobo <wuhaobo1994@gmail.com> Co-authored-by: tangwei12 <tangwei12@baidu.com>	5 years ago
Thunderbrook	0cb60c700d	add heter ps mode (#25682) ... * add heter ps mode * code style test=develop * add with_pslib test=develop * unitest test=develop * code style test=develop * code style test=develop * code style test=develop * code style test=develop * code style test=develop * code style test=develop * code style test=develop * code style test=develop * test monitor test=develop * prepare trainer test=develop * code style test=develop	5 years ago
Chen Weihang	0b54d54fd8	Fix index overflow bug of the CUDA kernel loop increment (#25435) ... * fix softmax_with_cross_entropy cuda kernel overflow bug, test=develop * replace old macro & for condition, test=develop * polish details, test=develop	5 years ago
hutuxian	1c224e26af	support CMatchAuc (#24990) ... Support CMatchAucCalculator based on CMatchRankAucCalculator with a new parameter ignore_rank	5 years ago
hutuxian	b8f17a049d	fix problem in dump and add log (#24891) ... * Fix the field length in LoD scenario * Fix the missed lod info when copy tensor in dump field * Add some log to make debug easy	5 years ago
Chen Weihang	d1062d5278	Replace all errors thrown by LOG(FATAL) with PADDLE_THROW (#24759) ... * remove REPLACE_ENFORCE_GLOG compile option & add ci rule prohibit LOG(FATAL) using, test=develop * remove ci test case, test=develop * replace all LOG(FATAL) & polish message, test=develop * fix typo, test=develop * polish error info detail, test=develop	5 years ago
ShenLiang	950892044f	fix conflict, test=develop (#24238)	5 years ago
hutuxian	e6b87b3193	Support AucRunner in PaddleBox (#22884) ... * Support AucRunner in PaddleBox * update some code style	5 years ago
hutuxian	123255cf9f	change InitializeGPU to InitializeGPUAndLoadModel (#24377) ... * Add InitializeGPUAndLoadModel to solve random hang when downloading sparse parameters. * Update SaveBase to solve test problem.	5 years ago
Chen Weihang	aa0f254fbe	Add macro BOOST_GET to enrich the error information of boost :: get (#24175) ... * add new macro BOOST_GET_SAFELY & unittests, test=develop * add different macro type, test=develop * fix get macro type in executor, test=develop * four macro part change backup * using one macro for all case, test=develop * revert attribute change, test=develop * change to three func to solve gcc4.8 bug, test=develop * polish some details, test=develop	5 years ago
xujiaqi01	1034ca316f	add timeout and http store in communication (#23436) ... * add timeout and http store in communication, add revert and confirm in fleet * test=develop	5 years ago
hutuxian	df64a96686	support set_test_mode and set comlog level(#23905)	5 years ago
xujiaqi01	d98084e7ec	add save with prefix (#23449) ... * add save with prefix * test=develop	5 years ago
hutuxian	94a3789fd0	Add AfsAPI in PaddleBox (#23419) ... * Involves AfsAPI to resolve slow downloading. * Mainly used in PaddleBox	5 years ago
xujiaqi01	3a45767d49	add fleet pslib pull and push sparse op and push dense op (#23139) ... * add fleet pslib pull and push sparse op and push dense op * test=develop	5 years ago
xujiaqi01	68ea1ad55b	add clear one table (#23089) ... * add clear_one_table * test=develop	5 years ago
danleifeng	ae3bb16d06	add MaskAucCalculator in paddlebox (#23157) ... * add maskauc in paddlebox; test=develop	5 years ago
hutuxian	0c30098f8b	Add need_save_delta parameter to solve OOM (#23097)	5 years ago
hutuxian	175954d894	PaddleBox Framework Part2 (#22466) ... * Add two types of Metric Calculator: MultiTaskCalculator & CmatchRankCalculator. * Add a config for DynamicAdjustChannelNum function to denote whether we will discard the remaining instances when they are not be distributed evenly. * Remove CPU code in Pull/PushSparse and we will add it back when testing it fully. * Fix some known issues: such as copying persistable vars after one epoch running.	5 years ago
hutuxian	1a7962be97	Paddlebox about box_wrapper (#22497) ... Refine PaddleBox Framework, Main functions: * Add MetricMsg util class, which can calculate metrics like AUC, bucket_error, COPC. * Replace FeedPass with new interface: BeginFeedPass & EndFeedPass * Refactor Pull/Push Sparse Function in box_wrapper. * Use CUDA Kernel to copy keys and copy feasign between tensor and boxps struct. * Cache copied keys in pull sparse in order to reuse it in push period.	5 years ago