240 Commits (b4a3b75002d4a61f5855884ecdd8bb3c29eb84a8)

Author	SHA1	Message	Date
123malin	b4a3b75002	bug fix: invalid learning rate decay in pserver async mode (#20325) ... * bug fix: invalid learning rate decay in pserver async mode	6 years ago
tangwei12	a010d883b4	doc fix, test=develop, test=document_fix (#20239) ... * doc fix, test=develop, test=document_fix	6 years ago
Chengmo	494d6cf252	Fix transpiler en doc (#20149) ... * test=develop,test=document_fix,fix transpiler doc,add API.spec	6 years ago
tangwei12	b5a410466c	Trainer heartbeat for async mode (#19600) ... Heartbeat for distributed async training.	6 years ago
Chengmo	728ec1b43d	Add GEO-SGD distribute training algorithm (#20018) ... * refector geo sgd & communicator	6 years ago
123malin	6c74e7387f	fix APIs, test=document_preview (#19954) ... * fix DistributeTranspilerConfig document, test=develop	6 years ago
tangwei12	6a1db2044c	fix sync_with_distributed_lookup_table, test=develop (#19737) ... fix wrong place with distributed_lookup_table	6 years ago
123malin	a25a716e87	Optimize fleet API: add input check for some interfaces (#18971) ... * fleet api add input check, test=develop	6 years ago
Yi Liu	4ef6b8457a	adapte fleet api for localsgd and support nccl comm configuration in executor (#19443) ... test=develop	6 years ago
tangwei12	65c7368400	Fix the correctness of async mode at distributed training (#18863) ... * fix correctness of the communicator * fix a bug in send thread when sending var context is empty, test=develop * add lookup_table_prefetch_op and prefetch optimize, test=develop * remove remote prefetch GPU supported * word2vec force with CPU, test=develop * test dist remote lookup table force with CPU, test=develop	6 years ago
tangwei12	19dac67e9f	fix distribute transpiler GRPC error code 4, RPC Deadline (#18984) ... * fix sync mode hang in transpiler * remove sync mode in send/recv * replace PADDLE_ENFORCE with PADDLE_ENFORCE_NE	6 years ago
gongweibao	29d8781240	Polish fleet API to support cuda collective mode and nccl2 mode. (#18966) ... Polish fleet API to support cuda collective mode and nccl2 mode	6 years ago
gongweibao	c0a82748cf	Polish backwards optimizer dependency codes and use more default values. (#18255)	6 years ago
HaoRen	b7128bac5f	supports collective communicated training (#18175) ... * fix prepare context redundant code problem, optimize executor by caching create_varaiables test=develop * supports collective training in executor * make fetch_list runable with variables, add more unittest for use_program_cache test=develop * fix comment test=develop * use unique name for nccl_id * supports output to stream in program_to_code * insert sync_comm_stream before regularization; add skip_op_callstack capability in program_to_code * set op role in collective training * add collective op role * remove orig file * add build optimizer by strategy * add collective strategy * refine collective strategy * add multi-process role maker * refine strategy building factory so that we can easily plugin more strategy * scale loss grad in collective sgd transpiler * add support for distributed fc * code format * revert some features for dist fc * add support for distributed fc training * fix prepare context redundant code problem, optimize executor by caching create_varaiables test=develop * supports collective training in executor * make fetch_list runable with variables, add more unittest for use_program_cache test=develop * use unique name for nccl_id * supports output to stream in program_to_code * insert sync_comm_stream before regularization; add skip_op_callstack capability in program_to_code * set op role in collective training * add collective op role * fix comment test=develop * remove orig file * add build optimizer by strategy * add collective strategy * refine collective strategy * add multi-process role maker * refine strategy building factory so that we can easily plugin more strategy * scale loss grad in collective sgd transpiler * add support for distributed fc * code format * revert some features for dist fc * add support for distributed fc training * test=develop add collective op unittest standard * test=develop remove the test_collective directory * test=develop remove the test_collective directory * remove slicegather test * code format for reducescatter * update attr of shard_index_op * Modify macro nccl_helper * remove test without distribute * macro collective_helper * marcro update * test=develop update support python3.5 * test=develop change gpu memory use to 0.1 when test * test=develop update ut equal func * test=develop set flags to 1.5 * test=develop fix pickle dumple py35 * test=develop fix divide in slice and add sync_comm_stream update atol and rtol to 1e-05 rm shard_index op and test modify read input from file to read from memory remove origin_program in framework and add i/o in c_sync_calc_stream * test=develop update unittest sync operator I/O	6 years ago
tangwei12	659b72a97c	fix document of python api get_startup_program() (#17764) ... * add example to get_startup_program() * fix example to get_startup_program()	6 years ago
yaoxuefeng	ac92e4c066	fix distributed_transpiler.py api test=develop (#17668)	6 years ago
gongweibao	0d561ef442	fix 2dconn test=develop (#17681)	6 years ago
gongweibao	65bbf950ee	Add multi-ncclcomm and 2D ncclallreduce support. (#17263)	6 years ago
Qiao Longfei	92e7d5d7cc	fix distribute doc test=develop (#17318) ... * fix distribute doc	6 years ago
Qiao Longfei	58f7695ab2	Async exe support communicator (#17386) ... Async exe support communicator	6 years ago
tangwei12	7330cd639c	truncated_gaussian_random supported in distributed training, test=develop (#17091)	6 years ago
tangwei12	1a4a51db2b	Fleet unify distributed training (#16791) ... * implement distributed transpiler with fleet	6 years ago
Qiao Longfei	0608f8ca56	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into add-async_sparse_param_update_recorder	6 years ago
Qiao Longfei	d640c6cfa9	fix pylint	6 years ago
Qiao Longfei	542b52fac3	fix trainer_id	6 years ago
Qiao Longfei	de65398cb8	update transpiler and listen and serv op	6 years ago
Qiao Longfei	b8491bfd4e	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into add-communicator	6 years ago
tangwei12	971f3bc9b0	fix params with only 1 dim (#15828) ... * fix params with only 1 dim * test=develop	6 years ago
Qiao Longfei	8bda4ab213	parameter recv can run	6 years ago
Qiao Longfei	fbd186bd5d	complete recv op	6 years ago
Qiao Longfei	4356f186b4	complete parameter_send	6 years ago
tangwei12	90df7ff378	transpiler.py code clean (#15555) ... * move var strusted to vars_distributed.py, add optimizer's block name, test=develop * rename optimzier's seems complex, revert it, test=develop * replace * with details, test=develop	6 years ago
Wu Yi	22db82c053	fix tangwei merge issue test=develop (#15506)	6 years ago
tangwei12	8b50ad80ff	checkpoint at distributed training (#14854) ... checkpoint for distributed training.	6 years ago
Qiao Longfei	810439a993	fix style test=develop	7 years ago
Qiao Longfei	b16e832d4d	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into fix-dist-sparse-decay	7 years ago
乔龙飞 Qiao Longfei	e1679b8847	Merge pull request #14893 from JiabinYang/feature/add_prefech_hs ... Feature/add prefech hs	7 years ago
Qiao Longfei	49cce3fd0e	fix dist sparse l2 decay ... test=develop	7 years ago
haowang101779990	66ea718452	en api improve format Dec 27 ... test=develop	7 years ago
JiabinYang	b2f789c66d	add test transpiler dist test, test=develop	7 years ago
JiabinYang	c35fdf1581	Merge branch 'add_prefetch_in_nce' of https://github.com/seiriosPlus/Paddle into feature/add_prefech_hs	7 years ago
gongweibao	f1fb64b17f	Add reduce sparse tensor feature. (#14757)	7 years ago
tangwei12	b653ed0516	add prefetch and remvoe selectedrows of bias	7 years ago
Wu Yi	aebc175cd4	add nccl2 dist tests (#14755) ... * add nccl2 dist tests test=develop * fix dist_base test=develop * fix tests test=develop * fix test on mac test=develop	7 years ago
tangwei12	4cb0100c8e	add prefetch in nce	7 years ago
Tink_Y	6d04a9cf47	fix api format and example (#14686) ... * fix api format and examples test=develop * Update executor.py test=develop * Update nn.py * Update nn.py test=develop * Update nn.py test=develop	7 years ago
Qiao Longfei	c8b0241da2	fix code style test=develop	7 years ago
Qiao Longfei	9589babe12	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into refactor-prefetch ... test=develop	7 years ago
Qiao Longfei	87e4edd2ea	fix grad_varname in remote prefetch	7 years ago
Qiao Longfei	d98c59fd2c	support none sliced variable	7 years ago