258 Commits (0e101c4f6fd4f2d038d725ecae5729d904ef694e)

Author	SHA1	Message	Date
Chengmo	e85fcaa712	Fix fluid.embedding in Distributed Training (#25174) ... * test=develop, fix_embedding	5 years ago
swtkiwi	f5c6dd6def	test=develop (#24522)	5 years ago
tangwei12	853f2e5272	fix bug at sync with communicator (#23077)	5 years ago
tianshuo78520a	433cef03e5	fix typo word (#22784)	5 years ago
tianshuo78520a	d2ba91aad1	fix typo words (#22653)	5 years ago
tangwei12	66a3150135	SYNC with communicaotor (#22344) ... * add sync communicator and implement	5 years ago
tangwei12	948299aec8	deprecated for distribute transpiler api (#22513) ... * add deprecated for distribute transpiler, will delete it after 2.0.0, test=develop	5 years ago
tangwei12	82bc814a57	integrated HALF_ASYNC to communicator (#21869) ... * add half_async in the communicator * fix DistributedStrategy	5 years ago
123malin	985bceac53	Bug fix for sparse recorder (#21969) ... * test=develop, bug fix for sparse recorder	5 years ago
Chengmo	418abc92f4	Update pyramid related OP (#21372) ... * add special way to add distribute vars， Update Pyramid hash op	5 years ago
Chengmo	5c33919328	Fix grad clip (#21784) ... * fix grad clip， clip op belongs to Backward op when running in Parameter Server mode.	5 years ago
123malin	7fb817d447	add distributed_strategy (#21710) ... * add distributed_strategy	5 years ago
tangwei12	9ad940fdfe	memory leak for cpu (#21174) ... * add fake init for the trainer, fix large memory hold in the trainer * do not merge recv vars from a remote endpoint, test=develop * add recv and save op, merge slice var in one op, save memory * remove hsigmoid with pull sparse, test=develop	5 years ago
hutuxian	c5aec2fe68	Paddlebox Related to Framework (#21586) ... * Add a single_process_multi_thread transpiler. * Add some UTs. * Fix some API description.	5 years ago
Kaipeng Deng	ebfb720a63	add Adam beta1/beta2 support Variable (#21234) ... * add Adam beta1/beta2 support Variable. test=develop	5 years ago
123malin	20cdff0e02	Optimize decay (#20816) ... * update pserver decay blocks * update distributed notify handler	5 years ago
tangwei12	1d925440ca	fix fetch handler error with pslib (#20679) ... * fix fetch handler error with pslib * fix distributed lookup table op with 1 pserver	5 years ago
Chengmo	940c6ff1c8	Fix communicator slow bug & fix communicator stop bug (#20366) ... * test=develop,Fix communicator slow bug * test=develop, delete if() in stop_worker() * test=develop * fix UT, test=develop * fix bug in fetch handler, test=develop * fix bug in fetch handler, test=develop * test=develop, fix fetch barrier bug * test=develop, bug fix * test=develop, bug fix * test=develop, fix bug	5 years ago
123malin	b4a3b75002	bug fix: invalid learning rate decay in pserver async mode (#20325) ... * bug fix: invalid learning rate decay in pserver async mode	5 years ago
tangwei12	a010d883b4	doc fix, test=develop, test=document_fix (#20239) ... * doc fix, test=develop, test=document_fix	5 years ago
Chengmo	494d6cf252	Fix transpiler en doc (#20149) ... * test=develop,test=document_fix,fix transpiler doc,add API.spec	5 years ago
tangwei12	b5a410466c	Trainer heartbeat for async mode (#19600) ... Heartbeat for distributed async training.	5 years ago
Chengmo	728ec1b43d	Add GEO-SGD distribute training algorithm (#20018) ... * refector geo sgd & communicator	5 years ago
123malin	6c74e7387f	fix APIs, test=document_preview (#19954) ... * fix DistributeTranspilerConfig document, test=develop	5 years ago
tangwei12	6a1db2044c	fix sync_with_distributed_lookup_table, test=develop (#19737) ... fix wrong place with distributed_lookup_table	5 years ago
123malin	a25a716e87	Optimize fleet API: add input check for some interfaces (#18971) ... * fleet api add input check, test=develop	6 years ago
Yi Liu	4ef6b8457a	adapte fleet api for localsgd and support nccl comm configuration in executor (#19443) ... test=develop	6 years ago
tangwei12	65c7368400	Fix the correctness of async mode at distributed training (#18863) ... * fix correctness of the communicator * fix a bug in send thread when sending var context is empty, test=develop * add lookup_table_prefetch_op and prefetch optimize, test=develop * remove remote prefetch GPU supported * word2vec force with CPU, test=develop * test dist remote lookup table force with CPU, test=develop	6 years ago
tangwei12	19dac67e9f	fix distribute transpiler GRPC error code 4, RPC Deadline (#18984) ... * fix sync mode hang in transpiler * remove sync mode in send/recv * replace PADDLE_ENFORCE with PADDLE_ENFORCE_NE	6 years ago
gongweibao	29d8781240	Polish fleet API to support cuda collective mode and nccl2 mode. (#18966) ... Polish fleet API to support cuda collective mode and nccl2 mode	6 years ago
gongweibao	c0a82748cf	Polish backwards optimizer dependency codes and use more default values. (#18255)	6 years ago
HaoRen	b7128bac5f	supports collective communicated training (#18175) ... * fix prepare context redundant code problem, optimize executor by caching create_varaiables test=develop * supports collective training in executor * make fetch_list runable with variables, add more unittest for use_program_cache test=develop * fix comment test=develop * use unique name for nccl_id * supports output to stream in program_to_code * insert sync_comm_stream before regularization; add skip_op_callstack capability in program_to_code * set op role in collective training * add collective op role * remove orig file * add build optimizer by strategy * add collective strategy * refine collective strategy * add multi-process role maker * refine strategy building factory so that we can easily plugin more strategy * scale loss grad in collective sgd transpiler * add support for distributed fc * code format * revert some features for dist fc * add support for distributed fc training * fix prepare context redundant code problem, optimize executor by caching create_varaiables test=develop * supports collective training in executor * make fetch_list runable with variables, add more unittest for use_program_cache test=develop * use unique name for nccl_id * supports output to stream in program_to_code * insert sync_comm_stream before regularization; add skip_op_callstack capability in program_to_code * set op role in collective training * add collective op role * fix comment test=develop * remove orig file * add build optimizer by strategy * add collective strategy * refine collective strategy * add multi-process role maker * refine strategy building factory so that we can easily plugin more strategy * scale loss grad in collective sgd transpiler * add support for distributed fc * code format * revert some features for dist fc * add support for distributed fc training * test=develop add collective op unittest standard * test=develop remove the test_collective directory * test=develop remove the test_collective directory * remove slicegather test * code format for reducescatter * update attr of shard_index_op * Modify macro nccl_helper * remove test without distribute * macro collective_helper * marcro update * test=develop update support python3.5 * test=develop change gpu memory use to 0.1 when test * test=develop update ut equal func * test=develop set flags to 1.5 * test=develop fix pickle dumple py35 * test=develop fix divide in slice and add sync_comm_stream update atol and rtol to 1e-05 rm shard_index op and test modify read input from file to read from memory remove origin_program in framework and add i/o in c_sync_calc_stream * test=develop update unittest sync operator I/O	6 years ago
tangwei12	659b72a97c	fix document of python api get_startup_program() (#17764) ... * add example to get_startup_program() * fix example to get_startup_program()	6 years ago
yaoxuefeng	ac92e4c066	fix distributed_transpiler.py api test=develop (#17668)	6 years ago
gongweibao	0d561ef442	fix 2dconn test=develop (#17681)	6 years ago
gongweibao	65bbf950ee	Add multi-ncclcomm and 2D ncclallreduce support. (#17263)	6 years ago
Qiao Longfei	92e7d5d7cc	fix distribute doc test=develop (#17318) ... * fix distribute doc	6 years ago
Qiao Longfei	58f7695ab2	Async exe support communicator (#17386) ... Async exe support communicator	6 years ago
tangwei12	7330cd639c	truncated_gaussian_random supported in distributed training, test=develop (#17091)	6 years ago
tangwei12	1a4a51db2b	Fleet unify distributed training (#16791) ... * implement distributed transpiler with fleet	6 years ago
Qiao Longfei	0608f8ca56	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into add-async_sparse_param_update_recorder	6 years ago
Qiao Longfei	d640c6cfa9	fix pylint	6 years ago
Qiao Longfei	542b52fac3	fix trainer_id	6 years ago
Qiao Longfei	de65398cb8	update transpiler and listen and serv op	6 years ago
Qiao Longfei	b8491bfd4e	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into add-communicator	6 years ago
tangwei12	971f3bc9b0	fix params with only 1 dim (#15828) ... * fix params with only 1 dim * test=develop	6 years ago
Qiao Longfei	8bda4ab213	parameter recv can run	6 years ago
Qiao Longfei	fbd186bd5d	complete recv op	6 years ago
Qiao Longfei	4356f186b4	complete parameter_send	6 years ago
tangwei12	90df7ff378	transpiler.py code clean (#15555) ... * move var strusted to vars_distributed.py, add optimizer's block name, test=develop * rename optimzier's seems complex, revert it, test=develop * replace * with details, test=develop	6 years ago