Paddle

Commit Graph

Author	SHA1	Message	Date
MRXLT	55098b975e	fleet support paddle.optimzier (#28026 ) fleet support paddle.optimzier * bug fix * fix fleet_base * bug fix * fix coverage	6 years ago
Chengmo	7f2aa2db3c	【paddle.fleet】Support Heter Parameter Server (#25998 ) * Support Heter Parameter Server	6 years ago
Dong Daxiang	50a5bcfc9d	【paddle.fleet】paddle.fleet -> paddle.distributed.fleet. (#26186 ) * move paddle.fleet to paddle.distributed.fleet	6 years ago
123malin	2191a08317	【paddle.fleet】fleet_util move to paddle.fleet (#25805 ) * test=develop,test=document_fix, remove the out args * fleet_util move to paddle.fleet Co-authored-by: WuHaobo <wuhaobo1994@gmail.com> Co-authored-by: tangwei12 <tangwei12@baidu.com>	6 years ago
Thunderbrook	0cb60c700d	add heter ps mode (#25682 ) * add heter ps mode * code style test=develop * add with_pslib test=develop * unitest test=develop * code style test=develop * code style test=develop * code style test=develop * code style test=develop * code style test=develop * code style test=develop * code style test=develop * code style test=develop * test monitor test=develop * prepare trainer test=develop * code style test=develop	6 years ago
tangwei12	caa90a6510	Integrated Trainer of Parameter Server (API add `fluid.contrib.layers.sparse_embedding` only) (#22957 ) * Integrated Trainer of Parameter Server	6 years ago
Chengmo	ddd604446b	Fix judge pslib transpiler (#23720 ) * fix judge pslib & ranspiler	6 years ago
tangwei12	c4a6a0e2e4	Revert "Integrated API of Parameter Server (#22710 )" test=develop (#23071 ) This reverts commit `66fce9e824`.	6 years ago
tangwei12	66fce9e824	Integrated API of Parameter Server (#22710 ) Fleet Parameter Server API Integrated	6 years ago
xujiaqi01	371f377bea	add GeneralRoleMaker (#22295 ) * add GeneralRoleMaker which is for general usage * test=develop	6 years ago
Zhen Wang	be2e3e67d9	Fix some typos in AMP. (#21354 ) * fix some typos in AMP. test=develop * delete useless codes. test=develop	7 years ago
gongweibao	6c2bc29cc0	Fix float16 optimizer. (#19682 ) Fix float16 optimizer	7 years ago
123malin	a25a716e87	Optimize fleet API: add input check for some interfaces (#18971 ) * fleet api add input check, test=develop	7 years ago
gongweibao	86f0591175	Remove node_num function. (#19167 ) node_num is not needed for users, so remove them and fix the bugs about it!	7 years ago
gongweibao	29d8781240	Polish fleet API to support cuda collective mode and nccl2 mode. (#18966 ) Polish fleet API to support cuda collective mode and nccl2 mode	7 years ago
jiaqi	02c370c3dc	support filelist size < trainer num && fix pull dense (#18956 ) * support filelist size < trainer num * pull dense when stop, to make sure local dense params are same as pserver, so save paddle model will save dense model same as pserver * enable QueueDataset train same filelist for serveral times	7 years ago
tangwei12	d845848341	do some odd jobs (#18641 ) do some odd jobs, test=develop	7 years ago
HaoRen	b7128bac5f	supports collective communicated training (#18175 ) * fix prepare context redundant code problem, optimize executor by caching create_varaiables test=develop * supports collective training in executor * make fetch_list runable with variables, add more unittest for use_program_cache test=develop * fix comment test=develop * use unique name for nccl_id * supports output to stream in program_to_code * insert sync_comm_stream before regularization; add skip_op_callstack capability in program_to_code * set op role in collective training * add collective op role * remove orig file * add build optimizer by strategy * add collective strategy * refine collective strategy * add multi-process role maker * refine strategy building factory so that we can easily plugin more strategy * scale loss grad in collective sgd transpiler * add support for distributed fc * code format * revert some features for dist fc * add support for distributed fc training * fix prepare context redundant code problem, optimize executor by caching create_varaiables test=develop * supports collective training in executor * make fetch_list runable with variables, add more unittest for use_program_cache test=develop * use unique name for nccl_id * supports output to stream in program_to_code * insert sync_comm_stream before regularization; add skip_op_callstack capability in program_to_code * set op role in collective training * add collective op role * fix comment test=develop * remove orig file * add build optimizer by strategy * add collective strategy * refine collective strategy * add multi-process role maker * refine strategy building factory so that we can easily plugin more strategy * scale loss grad in collective sgd transpiler * add support for distributed fc * code format * revert some features for dist fc * add support for distributed fc training * test=develop add collective op unittest standard * test=develop remove the test_collective directory * test=develop remove the test_collective directory * remove slicegather test * code format for reducescatter * update attr of shard_index_op * Modify macro nccl_helper * remove test without distribute * macro collective_helper * marcro update * test=develop update support python3.5 * test=develop change gpu memory use to 0.1 when test * test=develop update ut equal func * test=develop set flags to 1.5 * test=develop fix pickle dumple py35 * test=develop fix divide in slice and add sync_comm_stream update atol and rtol to 1e-05 rm shard_index op and test modify read input from file to read from memory remove origin_program in framework and add i/o in c_sync_calc_stream * test=develop update unittest sync operator I/O	7 years ago
Qiao Longfei	23f8a4b1c3	assign role_maker before use (#18137 ) fix role_maker bug test=develop	7 years ago
guru4elephant	58f3e1bad7	add paddle cloud role maker for customized usage, note this is only for industrial users that have cloud environment pre-configuration (#18121 ) add paddle cloud role maker for specific cloud usage. This pr will simplifies user's configuration in distributed training.	7 years ago
tangwei12	101f74cb19	fix save/load in fleet (#17675 ) * fix save/load in Fleet * add UT framework of Fleet	7 years ago
Qiao Longfei	58f7695ab2	Async exe support communicator (#17386 ) Async exe support communicator	7 years ago
tangwei12	565d309501	Reformat fleet API (#17135 ) * fix some logic in distributed transpiler, test=develop * reformat fleet API, test=develop	7 years ago
tangwei12	1a4a51db2b	Fleet unify distributed training (#16791 ) * implement distributed transpiler with fleet	7 years ago

24 Commits (adaec0073d02c0ea55bcabc4671ebfc8dbd3182c)