31 Commits (bc037c13c728f6d17d48408f986c78dea11d4a89)

Author	SHA1	Message	Date
Qiao Longfei	fb6cc3a1bd	follow commnet, optimize code and add comment test=develop	6 years ago
Qiao Longfei	9db1a9e128	change log level test=develop	6 years ago
Qiao Longfei	8342f12e31	fix set remote_prefetch test=develop	6 years ago
Qiao Longfei	d8974e6da0	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into add-async-ssa-graph-executor-communicator ... test=develop	6 years ago
chengduo	1096746cbf	Fuse Adam And SGD ops (#15933) ... * fuse optimizer	6 years ago
chengduo	ed61d67c73	Fix the interface of Pass::Apply (#16484) ... * modify the interface of Pass::Allay test=develop * Polish code test=develop * Fix Travis CI test=develop * fix Pass::Apply interface test=develop * Fix Travis CI test=develop	6 years ago
gongweibao	eb83abeac3	Add DGC(Deep Gradient Compression) interface. (#15841)	6 years ago
Qiao Longfei	37f6b9ab7a	fix build test=develop	6 years ago
Qiao Longfei	30618409db	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into add-async-ssa-graph-executor-communicator	6 years ago
chengduo	f26ba5bddd	Fuse AllReduce (#15921) ... * fuse all_reduce test=develop * add fuse_parameter_groups_size test=develop * Polish code test=develop * Fix travis-ci test=develop * Add SetGroupAccordingToLayers and SetGroupAccordingToGroupSize test=develop * Add SetGroupAccordingToMemorySize test=develop * fix multi_devices_graph test=develop * reset params_grads test=develop * Polish code test=develop	6 years ago
Wu Yi	6382b62f6b	Collective ops (#15572) ... * wip allreduce in op * wip * wip * wip * wip adding test * wip for conflict with mp mode * fix tests test=develop * fix cpu build test=develop * fix travis clang format test=develop * fix cpu build test=develop * update api.spec test=develop * delete comment test=develop * fix cpplint test=develop * fix test=develop * follow comment test=develop * add file test=develop * fix build test=develop * update test=develop * to be compatible with sync_bn, and fix mp mode in develop test=develop	6 years ago
Qiao Longfei	ff8054c5a7	can run	6 years ago
Qiao Longfei	4e218dabc5	code format test=develop	6 years ago
乔龙飞 Qiao Longfei	6e0e706198	Revert "cpu reduce mode did not need to broadcast params test=develop"	6 years ago
Qiao Longfei	ffd0d1d216	clean need_broadcast_var_ test=develop	6 years ago
Qiao Longfei	84367cf8bc	support async mode in dist mode parallel executor	6 years ago
Qiao Longfei	ea66979684	can run	6 years ago
chengduo	eabb2105fa	Refactor MultiDevSSAGraphBuilder (#15090) ... * Refactor ParallelExecutor test=develop * extract Reduce and AllReduce mode from MultiDevSSAGraphBuilder test=develop * Refactor MultiDevSSAGraphBuilder test=developt * Remove enable_data_balance test=develop * code refine test=develop * remove data balance test=develop * refine ScaleLossGradOp test=develop * remove uncessary file test=develop * code refine test=develop * modify function name test=develop * follow comments test=develop * add is_distribution field test=develop * set is_distribution test=develop * fix DistSSAGraphBuilder test=develop	6 years ago
chengduo	fe8495a758	[WIP] Refine MultiDevSSAGraph (#15040) ... * refine parallel_exe test=develop * rename shared_var_device * code refine * add test_weight_decay * remove Sort test=develop * Add SortForReduce test=develop * code refine test=develop * follow comment test=develop	6 years ago
Wu Yi	856f0da0fe	Fp16 training (#14992) ... * wip * wip * wip * wip for test * add fp16 tests test=develop * fix cpu build test=develop * fix test=develop * fix py3 tests test=develop * fix lr_scheduler dtype test=develop * fix test=dvelop * test fix ci compile test=develop * fix build and merge test=develop * fallback momentumop change to general test=develop * make fp16 lr schedule simple test=develop * fix ut test=develop * fix tests test=develop * remove fp16 learning rate cast test=develop	6 years ago
typhoonzero	da87f7a698	Revert "[Feature] Fp16 training for resnet50 (#14850)" ... This reverts commit 3d750f9c5a.	6 years ago
chengduo	550e7e410b	Code Clean parallel_executor.py (#14849) ... * refine parallel_executor * remove uncessary code test=develop	6 years ago
Wu Yi	3d750f9c5a	[Feature] Fp16 training for resnet50 (#14850) ... * wip * wip * wip * wip for test * add fp16 tests test=develop * fix cpu build test=develop * fix test=develop * fix py3 tests test=develop * fix lr_scheduler dtype test=develop * fix test=dvelop * test fix ci compile test=develop * fix build and merge test=develop * fallback momentumop change to general test=develop	6 years ago
peizhilin	7c8c9dc9bf	fix unit test cases	7 years ago
Xin Pan	34b401fc6c	clean up a global graph attr.	7 years ago
Wu Yi	26200f2e42	[1.1] [project] train imagenet using large batch size (#13766) ... * fix nccl2 lars dist support * put lars in momentum op * add tests lars * fix ci * fix cpu kernel * soft warning * remove lars in test_recognize_digits.py * move to another op * add file * update api.spec test=develop * update test=develop * fix api.spec test=develop * wip * wip, finish grad merge ops * wip, finish graph build * wip test running * work on 1 gpu * workable version * update * fix tests * fuse broadcast op * fix compile failed * refine * add batch merge test mnist * fix CI test=develop * fix build * use independent bn params for batch merge test=develop * update api.spec * follow comments and for test * wip * refine tests test=develop * follow comments test=develop * remove startup bn modify test=develop * follow comments test=develop * fix merge test=develop	7 years ago
Wu Yi	29c63d180f	[Feature] dist op role and lr op role, to support memory optimize with dist training (#13220) ... * wip * clean up * should fix running with memopt * add ut * mark lr schedule op role * hide lr_schedule_guard * use op_role_var instead of ufind * unify dist test name * wip for py3 support * fix var deref * fix python3 mem_opt order * remove comments	7 years ago
Xin Pan	e5b322051b	clean	7 years ago
Yancey1989	5ce1a960a5	move bcast op into pass	7 years ago
Xin Pan	5ae052bd14	remove some unused codes	7 years ago
Xin Pan	626abfc33a	code clean up and renaming ... Reduce one level of inheritence.	7 years ago