230 Commits (19dac67e9fd84b48b72fbe95fb30c47d866c4c44)

Author	SHA1	Message	Date
tangwei12	19dac67e9f	fix distribute transpiler GRPC error code 4, RPC Deadline (#18984) ... * fix sync mode hang in transpiler * remove sync mode in send/recv * replace PADDLE_ENFORCE with PADDLE_ENFORCE_NE	6 years ago
gongweibao	29d8781240	Polish fleet API to support cuda collective mode and nccl2 mode. (#18966) ... Polish fleet API to support cuda collective mode and nccl2 mode	6 years ago
gongweibao	c0a82748cf	Polish backwards optimizer dependency codes and use more default values. (#18255)	6 years ago
HaoRen	b7128bac5f	supports collective communicated training (#18175) ... * fix prepare context redundant code problem, optimize executor by caching create_varaiables test=develop * supports collective training in executor * make fetch_list runable with variables, add more unittest for use_program_cache test=develop * fix comment test=develop * use unique name for nccl_id * supports output to stream in program_to_code * insert sync_comm_stream before regularization; add skip_op_callstack capability in program_to_code * set op role in collective training * add collective op role * remove orig file * add build optimizer by strategy * add collective strategy * refine collective strategy * add multi-process role maker * refine strategy building factory so that we can easily plugin more strategy * scale loss grad in collective sgd transpiler * add support for distributed fc * code format * revert some features for dist fc * add support for distributed fc training * fix prepare context redundant code problem, optimize executor by caching create_varaiables test=develop * supports collective training in executor * make fetch_list runable with variables, add more unittest for use_program_cache test=develop * use unique name for nccl_id * supports output to stream in program_to_code * insert sync_comm_stream before regularization; add skip_op_callstack capability in program_to_code * set op role in collective training * add collective op role * fix comment test=develop * remove orig file * add build optimizer by strategy * add collective strategy * refine collective strategy * add multi-process role maker * refine strategy building factory so that we can easily plugin more strategy * scale loss grad in collective sgd transpiler * add support for distributed fc * code format * revert some features for dist fc * add support for distributed fc training * test=develop add collective op unittest standard * test=develop remove the test_collective directory * test=develop remove the test_collective directory * remove slicegather test * code format for reducescatter * update attr of shard_index_op * Modify macro nccl_helper * remove test without distribute * macro collective_helper * marcro update * test=develop update support python3.5 * test=develop change gpu memory use to 0.1 when test * test=develop update ut equal func * test=develop set flags to 1.5 * test=develop fix pickle dumple py35 * test=develop fix divide in slice and add sync_comm_stream update atol and rtol to 1e-05 rm shard_index op and test modify read input from file to read from memory remove origin_program in framework and add i/o in c_sync_calc_stream * test=develop update unittest sync operator I/O	6 years ago
tangwei12	659b72a97c	fix document of python api get_startup_program() (#17764) ... * add example to get_startup_program() * fix example to get_startup_program()	6 years ago
yaoxuefeng	ac92e4c066	fix distributed_transpiler.py api test=develop (#17668)	6 years ago
gongweibao	0d561ef442	fix 2dconn test=develop (#17681)	6 years ago
gongweibao	65bbf950ee	Add multi-ncclcomm and 2D ncclallreduce support. (#17263)	6 years ago
Qiao Longfei	92e7d5d7cc	fix distribute doc test=develop (#17318) ... * fix distribute doc	6 years ago
Qiao Longfei	58f7695ab2	Async exe support communicator (#17386) ... Async exe support communicator	6 years ago
tangwei12	7330cd639c	truncated_gaussian_random supported in distributed training, test=develop (#17091)	6 years ago
tangwei12	1a4a51db2b	Fleet unify distributed training (#16791) ... * implement distributed transpiler with fleet	6 years ago
Qiao Longfei	0608f8ca56	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into add-async_sparse_param_update_recorder	6 years ago
Qiao Longfei	d640c6cfa9	fix pylint	6 years ago
Qiao Longfei	542b52fac3	fix trainer_id	6 years ago
Qiao Longfei	de65398cb8	update transpiler and listen and serv op	6 years ago
Qiao Longfei	b8491bfd4e	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into add-communicator	6 years ago
tangwei12	971f3bc9b0	fix params with only 1 dim (#15828) ... * fix params with only 1 dim * test=develop	6 years ago
Qiao Longfei	8bda4ab213	parameter recv can run	6 years ago
Qiao Longfei	fbd186bd5d	complete recv op	6 years ago
Qiao Longfei	4356f186b4	complete parameter_send	6 years ago
tangwei12	90df7ff378	transpiler.py code clean (#15555) ... * move var strusted to vars_distributed.py, add optimizer's block name, test=develop * rename optimzier's seems complex, revert it, test=develop * replace * with details, test=develop	6 years ago
Wu Yi	22db82c053	fix tangwei merge issue test=develop (#15506)	6 years ago
tangwei12	8b50ad80ff	checkpoint at distributed training (#14854) ... checkpoint for distributed training.	6 years ago
Qiao Longfei	810439a993	fix style test=develop	6 years ago
Qiao Longfei	b16e832d4d	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into fix-dist-sparse-decay	6 years ago
乔龙飞 Qiao Longfei	e1679b8847	Merge pull request #14893 from JiabinYang/feature/add_prefech_hs ... Feature/add prefech hs	6 years ago
Qiao Longfei	49cce3fd0e	fix dist sparse l2 decay ... test=develop	6 years ago
haowang101779990	66ea718452	en api improve format Dec 27 ... test=develop	6 years ago
JiabinYang	b2f789c66d	add test transpiler dist test, test=develop	7 years ago
JiabinYang	c35fdf1581	Merge branch 'add_prefetch_in_nce' of https://github.com/seiriosPlus/Paddle into feature/add_prefech_hs	7 years ago
gongweibao	f1fb64b17f	Add reduce sparse tensor feature. (#14757)	7 years ago
tangwei12	b653ed0516	add prefetch and remvoe selectedrows of bias	7 years ago
Wu Yi	aebc175cd4	add nccl2 dist tests (#14755) ... * add nccl2 dist tests test=develop * fix dist_base test=develop * fix tests test=develop * fix test on mac test=develop	7 years ago
tangwei12	4cb0100c8e	add prefetch in nce	7 years ago
Tink_Y	6d04a9cf47	fix api format and example (#14686) ... * fix api format and examples test=develop * Update executor.py test=develop * Update nn.py * Update nn.py test=develop * Update nn.py test=develop	7 years ago
Qiao Longfei	c8b0241da2	fix code style test=develop	7 years ago
Qiao Longfei	9589babe12	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into refactor-prefetch ... test=develop	7 years ago
Qiao Longfei	87e4edd2ea	fix grad_varname in remote prefetch	7 years ago
Qiao Longfei	d98c59fd2c	support none sliced variable	7 years ago
Qiao Longfei	af2f5fc824	fix some bugs	7 years ago
tangwei12	3639d99f99	Fix save and load lookup table/optimizer vars (#14301) ... * fix mkdir conflict * fix load/save lookup tables test=develop * add lookup_table_utils * fix load optimize vars on pserver * delete lookup table utils * fix save and load lookup tables * fix load optimizer var * fix load optimizer var, test=develop * fix python 3 style, test=develop * move lookup_table_utils to contrib utils	7 years ago
Qiao Longfei	2b6c0c09d6	add unit test	7 years ago
Qiao Longfei	cc6ef41dc3	update dist transpiler	7 years ago
Qiao Longfei	080740b340	Merge pull request #14300 from jacquesqiao/dist-table-support-optimizer-regular ... dist table support other optimize and regular config	7 years ago
Qiao Longfei	d03cbd1b8c	follow comment test=develop	7 years ago
typhoonzero	f3eafec19d	fix pserver weight decay multi inputs test=develop	7 years ago
Qiao Longfei	ffd5a832d8	fix code style	7 years ago
Qiao Longfei	866d6bfe59	dist table support other optimize and regular config	7 years ago
Wu Yi	8fc05e0373	fix cpu build test=develop (#14260)	7 years ago