320 Commits (ebc7ffc300a4095c568502116f9808a9ff1ebc9b)

Author	SHA1	Message	Date
Wilber	a90fa54092	Compile without nccl deps. [1/2] (#22509) ... 支持不依赖nccl进行编译。[1/2] 多卡下，如果没有打开WITH_NCCL开关编译，多卡不能通信，则只能选择一张卡使用。 Co-authored-by: 石晓伟 <39303645+Shixiaowei02@users.noreply.github.com>	5 years ago
Wilber	7bc4b09500	add WITH_NCCL option for cmake. (#22384) ... cmake选项中添加了WITH_NCCL，显示指定是否编译NCCL的部分代码，WITH_NCCL默认打开，但如果WITH_GPU为OFF，则关闭WITH_NCCL 添加了PADDLE_WITH_NCCL定义 单机单卡能够关闭NCCL编译，多卡的话需要默认打开NCCL，如果关闭NCCL，则只能使用单卡 Co-authored-by: 石晓伟 <39303645+Shixiaowei02@users.noreply.github.com>	5 years ago
Huihuang Zheng	dd4361568e	Add ParallelExecutor Test for Cond API and Fix PE Checks Shape Bug (#22029)	5 years ago
Zeng Jinle	89966525f1	Polish reference count pass (#21324) ... * fix ref_cnt pass, test=develop * add cpp unittests to reference_count_pass, test=develop * follow comments, test=develop	5 years ago
Chen Weihang	952508527a	Polish some PE code details (#21274) ... * polish code details, test=develop * futher polish hint msg, test=develop	5 years ago
Zeng Jinle	d625aaf0c1	remove so many logs of parallel executor, test=develop (#21105)	5 years ago
wopeizl	5452b6a152	remove the useless warning for user to avoid confuse test=develop (#19871) ... * remove the useless warning for user to avoid confuse test=develop	5 years ago
Zeng Jinle	db26de8389	[Bug fix] Disable memory reuse on feeded variables (#19835) ... * fix memory reuse bug on feeding variables, test=develop * add comments to reference count members, test=develop	6 years ago
Zeng Jinle	754fd57ed7	disable memory optimization passes when FLAGS_use_ngraph=True, test=develop (#19778)	6 years ago
Zeng Jinle	0daa5c9772	Make leaky relu inplacable (#19676) ... * make leaky relu inplacable, test=develop * force add unittests to pass coverage, test=develop	6 years ago
chengduo	e340df013e	Support feed single persistable variable to PE (#19417) ... * update executor feed	6 years ago
Leo Chen	8f53735437	Fix memory overwriting of tensors returned by executor (#19030) ... * fix memory overlapping of fetch var (return of executor.run), test=develop * fix wrong usage of ParallelExecutor in op_test, test=develop * remove useless parameter and simplify code * avoid tensor destruct untimely, test=develop * add testcase independent of OpTest, test=develop	6 years ago
Zeng Jinle	8008ab4e6b	Remove legacy C++ memory optimization codes (#18834) ... * remove legacy memory optimization codes, test=develop * follow huihuang's comments,test=develop * follow luotao's comments, test=develop	6 years ago
Zeng Jinle	a802da650b	Feature/mem opt pass refactor (#18735) ... * first version memory optimize pass, test=develop * remove move_tensor_sharing_pass, test=develop * refine code comments, add unittests, test=develop * turn off memory_optimize by default, test=develop * follow huihuang's comments, test=develop * follow chengduoZH's comments, test=develop * fix grammar error, add const qualifier, fix pass_test exception message, test=develop * follow chengduoZH's comments 2nd, test=develop	6 years ago
gongweibao	c0a82748cf	Polish backwards optimizer dependency codes and use more default values. (#18255)	6 years ago
Zeng Jinle	d3003a1620	Feature/buffer_shared_inplace (#17911) ... * feature/buffer_shared_inplace, test=develop * refine code, test=develop * fix elementwise_add op cpu inplace and sum inplace bug, test=develop * add unittest and debug log, test=develop * fix parallel_executor scope bug, polish code, test=develop * fix sum op, activation op, single_in_place_inference bug, test=develop * remove kLocalExecScopeName, test=develop * fix unittest,test=develop * fix out_var first version bug, test=develop * follow comments,test=develop	6 years ago
chengduo	8ed33bf91f	Fix Bug-prone code of PE (#18354) ... * update pe reduce config test=develop * drop the local_exe_scopes of the previous parallel_executor test=develop	6 years ago
chengduo	135a59ed45	update reduce config (#18334) ... test=develop	6 years ago
chengduo	14e1e165df	update alloc_continuous_space_for_grad_pass (#18287) ... test=develop	6 years ago
chengduo	25f3cd6486	Update execution_strategy option default value (#18183) ... * update execution_strategy option default value test=develop * fix doc error test=develop	6 years ago
chengduo	4978db2c10	Remove nccl dep when the number of GPU is 1 (#18158) ... * remove nccl dep when the number of GPU is 1 test=develop	6 years ago
gongweibao	f5caf3443c	Fix reinitialized ncclid error! (#18025)	6 years ago
chengduo	b5a1c1463d	Update CPU_NUM config (#18059) ... * update CPU_NUM config test=develop	6 years ago
gongweibao	dd4cd352c7	Fix sync_batch_norm_op ncclallreduce error! (#17918)	6 years ago
wopeizl	453a49b1bc	Make ParallelExecutor support Windows GPU (#17787) ... * fix the ParallelExecutor on Windows test=develop * restrict to use one GPU only under windows	6 years ago
chengduo	863c75168c	polish error doc (#17772) ... test=develop	6 years ago
chengduo	67c8dade58	Add Event in ScopeBuffer Executor (#17667) ... * add event for fast executor and add threads for scopebuffer executor test=develop	6 years ago
gongweibao	0d561ef442	fix 2dconn test=develop (#17681)	6 years ago
gongweibao	65bbf950ee	Add multi-ncclcomm and 2D ncclallreduce support. (#17263)	6 years ago
chengduo	bc833945a4	Add DropLocalExeScopes in ParallelExecutor (#17297) ... * reset drop local scope counter test=develop	6 years ago
chengduo	04bd413acb	Code Clean: Move all pass to paddle::framework::ir (#17228) ... * move pass to ir * polish code test=develop * fix dependency test=develop	6 years ago
songhao	c2e20e2a29	fix build warning like 'comparison between signed and unsigned (#17240) ... integer', test=develop	6 years ago
dongdaxiang	3c2d236815	remove all warnings ... test=develop	6 years ago
chengduo	ea2a2f778a	Fix the bug of AllReduceDepPass (#16393)	6 years ago
Qiao Longfei	d8974e6da0	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into add-async-ssa-graph-executor-communicator ... test=develop	6 years ago
chengduo	ed61d67c73	Fix the interface of Pass::Apply (#16484) ... * modify the interface of Pass::Allay test=develop * Polish code test=develop * Fix Travis CI test=develop * fix Pass::Apply interface test=develop * Fix Travis CI test=develop	6 years ago
Qiao Longfei	30618409db	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into add-async-ssa-graph-executor-communicator	6 years ago
Wu Yi	6382b62f6b	Collective ops (#15572) ... * wip allreduce in op * wip * wip * wip * wip adding test * wip for conflict with mp mode * fix tests test=develop * fix cpu build test=develop * fix travis clang format test=develop * fix cpu build test=develop * update api.spec test=develop * delete comment test=develop * fix cpplint test=develop * fix test=develop * follow comment test=develop * add file test=develop * fix build test=develop * update test=develop * to be compatible with sync_bn, and fix mp mode in develop test=develop	6 years ago
qingqing01	8ad672a287	Support sync batch norm. (#16121) ... * Support Sync Batch Norm. * Note, do not enable it in one device. Usage: build_strategy = fluid.BuildStrategy() build_strategy.sync_batch_norm = True binary = fluid.compiler.CompiledProgram(tp).with_data_parallel( loss_name=loss_mean.name, build_strategy=build_strategy)	6 years ago
Yan Xu	30568473ec	fix broadcast on mp mode (#15951) ... * fix broadcast with mp mode * polish code test=develop * fix bcast strategy test=develop * fic cpplint test=develop * fix py3 failed test=develop * fix comment test=develop * update comment test=develop	6 years ago
Qiao Longfei	a23f1ee85a	optimize code	6 years ago
Qiao Longfei	5e8de51409	code format test=develop	6 years ago
Qiao Longfei	8744f9a083	fix parallel executor async mode	6 years ago
Qiao Longfei	847e4f4e85	pure async mode train	6 years ago
Qiao Longfei	f768fbf715	support multi graph ... test=develop	6 years ago
Qiao Longfei	dab7f36909	optimize code test=develop	6 years ago
Qiao Longfei	cf0511f21e	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into add-async-ssa-graph-executor ... test=develop	6 years ago
Qiao Longfei	43c82376cb	use one graph	6 years ago
Qiao Longfei	10393dd0d1	add some check test=develop	6 years ago
Qiao Longfei	f4f4816b0c	fix gpu error test=develop	6 years ago