28 Commits (a501a7b0caadcfbbcb2f637ed58b52aa07f7d2dc)

Author	SHA1	Message	Date
lilong12	a501a7b0ca	[3D-parallel] add 1f1b scheduler for pipeline (#31566) ... * add 1f1b scheduler for pp, test=develop	4 years ago
lilong12	0205e9f84e	remove the send/recv of tensor size (#31460) ... * remove the send/recv of tensor size, but users have to specify the shape of the received var explicitly.	4 years ago
lilong12	dc8dfba35b	align the default value of some configuration for fleet to that of single cards (#30740) ... * update, test=develop	4 years ago
WangXi	31ed9c9eed	Fleet distributed strategy support pure fp16 (#30754)	4 years ago
lilong12	7fbc68a2c0	update, test=develop (#30692)	4 years ago
JZ-LIANG	75936d838f	Recompute Offload (#30233)	4 years ago
Chengmo	528e03fc08	【Paddle.Fleet】Fix tensor table (#30075) ... * add tensor table	4 years ago
WangXi	9cbcc6cadc	fleet sync build strategy, test=develop (#29732)	5 years ago
JZ-LIANG	d33d468f02	[Sharding] add hybrid-dp feature (#29518) ... * Sharding add hybrid-dp feature * update sharding in distributed_strategy * update sharding unitest * revise code format for sharding	5 years ago
ShenLiang	46b73e6cd9	Change the api of DataParallel and Fleet (#29224)	5 years ago
mapingshuo	81244fbfab	add sharding strategy in fleet(#27900) ... * add sharding	5 years ago
Chengmo	c5f2802d56	【paddle.fleet】Update fleetrun & ps-heter (#27472) ... * refine fleetrun.ps_launch * update fleet run for multi device support * ps_graph support ps-gpu * fix heter save * add heter save unittest * fix unittest & simple code * update fleetrun * fix fleetrun * fix launch barrier * fix role maker * add paddlecloud rolemaker unittest * rename heter_worker_device_guard	5 years ago
Chengmo	0e101c4f6f	Fix test dist fleet heter ctr (#27513) ... * fix test_dist_fleet_heter_ctr & peformance update	5 years ago
WangXi	e550fc02ae	fleet2.0 add fp16 grad compression (#27480)	5 years ago
ShenLiang	54b81fa32c	add adaptivelsgd in meta_optimizer (#27289) ... * add adaptivelsgd * Todo fix the code to avoid the conflict.	5 years ago
ShenLiang	2b6a5793fe	remove auto mode from localsgd optimizer (#27237) ... * rm auto from localsgd	5 years ago
JZ-LIANG	5d039f4086	modified the implement of Lars optimizer (#26733) ... add lars to fleet meta optimizer	5 years ago
Dong Daxiang	08d736ad78	【paddle.fleet】add cudnn related strategies to DistributedStrategy (#26598) ... * add cudnn related strategies to DistributedStrategy	5 years ago
JZ-LIANG	54003b873e	【paddle.fleet】add lamb to fleet meta optimizer (#26025) ... add lamb to fleet meta optimizer	5 years ago
tangwei12	c14ec8782b	【paddle.fleet】Feature/fleet ps api 2.0 (#25857) ... * add paddle.fleet.AsyncOptimizer Co-authored-by: dongdaxiang <dongdaxiang@baidu.com>	5 years ago
WangXi	2c9d0f3cb9	【paddle.fleet】Add dgc to fleet meta optimizer (#25738) ... Add dgc to fleet meta optimizer, rm dgc from optimizer all	5 years ago
WangXi	a6c87fd091	Add amp to fleet meta optimizer, test=develop (#25770)	5 years ago
JZ-LIANG	8ebffc78c9	add lars to fleet meta optimizer (#25884)	5 years ago
Dong Daxiang	8d2896f1fe	【paddle.fleet】Fleet run graph in Executor and add two more strategies (#25844) ... * split meta optimizer files * add graph execution in execution, update two properties in DistributedStrategy, unit tests for these features	5 years ago
Dong Daxiang	a96d54ac19	Generate final strategy (#25782) ... * refine strategy compiler and meta optimizers make async as a_sync	5 years ago
Dong Daxiang	920d998f1e	add more settings for distributed strategy (#25685) ... * add more settings for distributed strategy Basically, DistributedStrategy has several parts of configurations: - BuildStrategy: the same as paddle.fluid.BuildStrategy, but the distributed arguments are moved out of BuildStrategy - ExecutionStrategy: the same as paddle.fluid.ExecutionStrategy - collective communication configs: nccl_comm_num, hierarchical allreduce and so on - distributed algorithms: async_update(mainly used in PS), lars, lamb and so on	5 years ago
Dong Daxiang	e657d7062d	fleet base initial implementation and the API (#25442) ... refactor fleet api under paddle.fleet update DistributedStrategy	5 years ago
Dong Daxiang	d5e40d1ba9	Paddle fleet distributed strategy (#25379) ... * add paddle.fleet.DistributedStrategy for 2.0	5 years ago