720 Commits (bda92434db2d75c9c1f29de84005df28c7b1c9e5)

Author	SHA1	Message	Date
chengduo	f26ba5bddd	Fuse AllReduce (#15921) ... * fuse all_reduce test=develop * add fuse_parameter_groups_size test=develop * Polish code test=develop * Fix travis-ci test=develop * Add SetGroupAccordingToLayers and SetGroupAccordingToGroupSize test=develop * Add SetGroupAccordingToMemorySize test=develop * fix multi_devices_graph test=develop * reset params_grads test=develop * Polish code test=develop	6 years ago
Wu Yi	6382b62f6b	Collective ops (#15572) ... * wip allreduce in op * wip * wip * wip * wip adding test * wip for conflict with mp mode * fix tests test=develop * fix cpu build test=develop * fix travis clang format test=develop * fix cpu build test=develop * update api.spec test=develop * delete comment test=develop * fix cpplint test=develop * fix test=develop * follow comment test=develop * add file test=develop * fix build test=develop * update test=develop * to be compatible with sync_bn, and fix mp mode in develop test=develop	6 years ago
Qiyang Min	c7f1f3ed0c	Merge pull request #16214 from velconia/imperative_infer_var_type ... Implement imperative infer var type	6 years ago
minqiyang	b40e41fbd1	Polish code style ... test=develop	6 years ago
minqiyang	36dce65bb3	Take DataType and VarType apart ... test=develop	6 years ago
minqiyang	438bca9c3d	Implement Runtime Var Type Inference ... test=develop	6 years ago
qingqing01	8ad672a287	Support sync batch norm. (#16121) ... * Support Sync Batch Norm. * Note, do not enable it in one device. Usage: build_strategy = fluid.BuildStrategy() build_strategy.sync_batch_norm = True binary = fluid.compiler.CompiledProgram(tp).with_data_parallel( loss_name=loss_mean.name, build_strategy=build_strategy)	6 years ago
minqiyang	ca392c7e97	Implement infer var type context	6 years ago
liuwei1031	1c6caf8466	1. disable reuse SELECTED_ROWS type variable (#16150) ... 2. remove lod check in reshape op test=develop	6 years ago
Zhen Wang	5685a48c23	Add some fixme. test=develop	6 years ago
Zeng Jinle	472f16b5aa	Merge pull request #16063 from sneaxiy/enhance_gc ... Enhance gc	6 years ago
Qiao Longfei	ff8054c5a7	can run	6 years ago
Qiao Longfei	3225e19591	fix remove recv op	6 years ago
Qiao Longfei	fe6a840924	fix delete recv ops	6 years ago
Wu Yi	d206582337	add parallel graph dist test (#16076) ... * add parallel graph dist test=develop * update test=develop * update style test=develop	6 years ago
Qiao Longfei	446fdf9563	fix compile problem	6 years ago
Qiao Longfei	a23f1ee85a	optimize code	6 years ago
Qiao Longfei	a0bb18beec	Merge branch 'add-async-ssa-graph-executor' of ssh://github.com/jacquesqiao/Paddle into add-async-ssa-graph-executor-communicator	6 years ago
liuwei1031	045e5911bf	fix a code bug which cause crash when empty variable is used, test=develop (#16080)	6 years ago
sneaxiy	7b608396fe	fix travis-ci format check ... test=develop	6 years ago
Qiao Longfei	255b36dad2	can run	6 years ago
Qiao Longfei	5e8de51409	code format test=develop	6 years ago
Qiao Longfei	4e218dabc5	code format test=develop	6 years ago
sneaxiy	814a759061	merge develop ... test=develop	6 years ago
sneaxiy	597dc65e76	enhance gc ... test=develop	6 years ago
liuwei1031	caadd0581d	add IfElse test case for ir memory optimize (#15998) ... * add ir memory optimize test case for IfElse op, test=develop * fix some unitttest failure by force using the python memory_optimize, test=develop * tweak comments, test=develop * fix unittest, test=develop * fix unittest, test=develop	6 years ago
Qiao Longfei	f28c258453	code clean test=develop	6 years ago
Qiao Longfei	8c38aca954	tmp commit	6 years ago
Qiao Longfei	fab1b54d99	Merge branch 'add-communicator' of ssh://github.com/jacquesqiao/Paddle into add-async-ssa-graph-executor-communicator	6 years ago
Qiao Longfei	e70b1727ef	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into add-async-ssa-graph-executor	6 years ago
sneaxiy	a9ea99d700	merge develop	6 years ago
chengduo	ae37f82964	Unified ParallelExecutor and Compiler (#15970) ... * Unified ParallelExecutor and Compiler	6 years ago
Qiao Longfei	847e4f4e85	pure async mode train	6 years ago
Qiao Longfei	49f2f4f91d	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into add-communicator	6 years ago
Qiao Longfei	f768fbf715	support multi graph ... test=develop	6 years ago
Qiao Longfei	ff01d70583	fix style ... test=develop	6 years ago
Qiao Longfei	dab7f36909	optimize code test=develop	6 years ago
Qiao Longfei	cf0511f21e	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into add-async-ssa-graph-executor ... test=develop	6 years ago
Qiao Longfei	43c82376cb	use one graph	6 years ago
dzhwinter	660e410655	Merge pull request #15855 from dzhwinter/fix/nightly_test ... accelerate memory optimize process	6 years ago
Xin Pan	a6e3cd5eb7	Merge pull request #15425 from panyx0718/api ... Pass graph to parallel executor instead of program	6 years ago
Qiao Longfei	b8491bfd4e	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into add-communicator	6 years ago
dzhwinter	a71f2fbe4f	fix default value. test=develop	6 years ago
乔龙飞 Qiao Longfei	ec8e878200	Merge pull request #15840 from jacquesqiao/revert-15684-revert-15661-fix-cpu-broadcast ... fix cpu broadcast	6 years ago
Qiao Longfei	2b7931d5c9	refine code test=develop	6 years ago
Xin Pan	0362ef75f4	fix ... test=develop	6 years ago
Xin Pan	12a0e2ed9d	polish codes ... test=develop	6 years ago
Xin Pan	19d78f6797	polish ... test=develop	6 years ago
Qiao Longfei	ecedd531c1	fix code bug test=develop	6 years ago
Qiao Longfei	f4f4816b0c	fix gpu error test=develop	6 years ago
Xin Pan	32d5a16036	resolve conflicts ... test=develop	6 years ago
Qiao Longfei	3f9263f67e	optimize style test=develop	6 years ago
Qiao Longfei	4233d0a820	add more comment test=develop	6 years ago
Qiao Longfei	3bccc1e6e2	optimize broadcast logic test=develop	6 years ago
Xin Pan	26e32e095a	allow compiler to use graph ... test=develop	6 years ago
Qiao Longfei	12f6b8c3d6	change the include of ThreadPool.h test=develop	6 years ago
Qiao Longfei	7f3be09045	fix multi graph test=develop	6 years ago
Qiao Longfei	31a05d3efd	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into add-async-ssa-graph-executor ... test=develop	6 years ago
Qiao Longfei	62f1248ff5	fix use gpu test=develop	6 years ago
Xin Pan	6019054cdd	Merge pull request #15716 from Yancey1989/refine_pg ... Refine ParallelGraph Execution	6 years ago
Dun	a83e470405	Profiler refine and add CUDA runtime api tracer (#15301) ... * refine profiler && add runtime tracer * test=develop * test=develop * test=develop * test=develop * test=develop * test=develop * test=develop * test=develop * fix bug && test=develop * add thread id map && test=develop * test=develop * testing * bug fix * remove cuda event && refine code && test=develop * test=develop * test=develop * test=develop * fix windows temp file && test=develop * test=develop * fix windows bug && test=develop * fix start up issue && test=develop * code polish && test=develop * remove unused code && test=develop * add some cupti cbid && test=develop * add FLAGS_multiple_of_cupti_buffer_size && test=develop * fix compile error && test=develop * add keyword && test=develop * fix && test=develop * code polish && test=develop	6 years ago
Qiao Longfei	cc71e89499	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into add-async-ssa-graph-executor ... test=develop	6 years ago
dzhwinter	f2e8409f5a	Merge pull request #15795 from dzhwinter/fix/block_desc ... fix bug when op node has no block pointer	6 years ago
tensor-tang	e1c707fe9c	fix warnings (#15790) ... * fix warnings test=develop * fix enforce test test=develop	6 years ago
Yancey1989	4b193db14c	polish code test=develop	6 years ago
dzhwinter	6deb17ed8c	fix default value. test=develop	6 years ago
dzhwinter	089d262c41	fix default value. test=develop	6 years ago
dzhwinter	9c92d0304f	fix default value. test=develop	6 years ago
Yancey1989	d5090c892d	polish code test=develop	6 years ago
Yancey1989	0f8bd73cc9	cleanup code test=develop	6 years ago
Yancey1989	5677c9d4ee	update comment test=develop	6 years ago
Yancey1989	642fd68ce0	update by comment test=develop	6 years ago
dzhwinter	d94a314db5	add reference. test=develop	6 years ago
dzhwinter	591ad33e32	polish code for reading. test=develop	6 years ago
dzhwinter	18afb77e78	polish code for reading. test=develop	6 years ago
dzhwinter	684b572307	polish code for reading. test=develop	6 years ago
dzhwinter	3787e61fca	polish code for reading. test=develop	6 years ago
dzhwinter	c1455e606d	Merge remote-tracking branch 'origin/develop' into cherry-pick/memory ... test=develop	6 years ago
dzhwinter	d376cf71b7	polish code for reading. test=develop	6 years ago
Yancey1989	7cd6de37f5	fix cpu test=develop	6 years ago
Yancey1989	bd0d44af24	fix build failed test=develop	6 years ago
Yancey1989	ecdd1166b8	cleanup code test=develop	6 years ago
Yancey1989	73005ee00d	cleanup code test=develop	6 years ago
Yancey1989	88d3dc949e	Merge branch 'develop' of github.com:PaddlePaddle/Paddle into refine_pg ... test=develop	6 years ago
Yancey1989	f3463ecb6e	refine pg execution	6 years ago
dzhwinter	283573c6aa	add details. test=develop	6 years ago
乔龙飞 Qiao Longfei	45b19cbc9a	Revert "Revert "cpu reduce mode did not need to broadcast params test=develop""	6 years ago
dzhwinter	6d6ddcfe15	add details. test=develop	6 years ago
dzhwinter	11afbe0f53	add details. test=develop	6 years ago
tensor-tang	e49706c80e	Merge pull request #15659 from GBuella/add_to_string ... Tests - add some missing to_string calls	6 years ago
Gabor Buella	da9c94da33	Clang build fixes (#15628) ... * Remove some superfluous std::move calls The std:move triggered a build error (with -Werror): ``` [ 9%] Building CXX object paddle/fluid/memory/allocation/CMakeFiles/allocator_facade.dir/allocator_facade.cc.o /home/tej/code/gbuella_paddle/paddle/fluid/memory/allocation/allocator_facade.cc:86:29: error: moving a temporary object prevents copy elision [-Werror,-Wpessimizing-move] [this] { return std::move(CreateAllocatorWithChunk()); }, capacity); ^ /home/tej/code/gbuella_paddle/paddle/fluid/memory/allocation/allocator_facade.cc:86:29: note: remove std::move call here [this] { return std::move(CreateAllocatorWithChunk()); }, capacity); ^~~~~~~~~~ ~ 1 error generated. ``` See: https://reviews.llvm.org/D7633 * Remove a superfluous lambda capture from framework/operator.h ``` [ 10%] Building CXX object paddle/fluid/platform/CMakeFiles/device_context.dir/init.cc.o In file included from /home/tej/code/gbuella_paddle/paddle/fluid/platform/init.cc:19: /home/tej/code/gbuella_paddle/paddle/fluid/framework/operator.h:229:21: error: lambda capture 'this' is not used [-Werror,-Wunused-lambda-capture] [this](Variable* var) { return var; }); ^~~~ 1 error generated. ``` Changing it to `return it->second;`, as is in the function below. * Rethrow an exception (instead of copying it) ``` [ 11%] Building CXX object paddle/fluid/framework/CMakeFiles/operator.dir/operator.cc.o /home/tej/code/gbuella_paddle/paddle/fluid/framework/operator.cc:191:13: error: local variable 'exception' will be copied despite being thrown by name [-Werror,-Wreturn-std-move] throw exception; ^~~~~~~~~ /home/tej/code/gbuella_paddle/paddle/fluid/framework/operator.cc:191:13: note: call 'std::move' explicitly to avoid copying throw exception; ^~~~~~~~~ std::move(exception) ``` See https://reviews.llvm.org/D43322 for an explanation of this diagnostic message. * Remove an unused variable ``` /home/tej/code/gbuella_paddle/paddle/fluid/framework/operator.cc:884:16: error: private field 'scope_' is not used [-Werror,-Wunused-private-field] const Scope& scope_; ^ ``` * struct ComputationOpHandle -> class ComputationOpHandle ``` [ 13%] Building CXX object paddle/fluid/framework/details/CMakeFiles/memory_early_delete_pass.dir/memory_early_delete_pass.cc.o In file included from /home/tej/code/gbuella_paddle/paddle/fluid/framework/details/memory_early_delete_pass.cc:21: /home/tej/code/gbuella_paddle/paddle/fluid/framework/details/reference_count_pass_helper.h:30:1: error: class 'ComputationOpHandle' was previously declared as a struct; this is valid, but may result in linker errors under the Microsoft C++ ABI [-Werror,-Wmismatched-tags] class ComputationOpHandle; ^ /home/tej/code/gbuella_paddle/paddle/fluid/framework/details/computation_op_handle.h:29:8: note: previous use is here struct ComputationOpHandle : public OpHandleBase { ^ /home/tej/code/gbuella_paddle/paddle/fluid/framework/details/reference_count_pass_helper.h:30:1: note: did you mean struct here? class ComputationOpHandle; ^~~~~ struct 1 error generated. ``` * Fix name() methods under fluid/operators ``` In file included from /home/tej/code/gbuella_paddle/paddle/fluid/operators/jit/gen/act.cc:15: In file included from /home/tej/code/gbuella_paddle/paddle/fluid/operators/jit/gen/act.h:19: /home/tej/code/gbuella_paddle/paddle/fluid/operators/jit/gen/jitcode.h:71:23: error: 'name' overrides a member function but is not marked 'override' [-Werror,-Winconsistent-missing-override] virtual const char* name() const = 0; ^ /home/tej/code/gbuella_paddle/paddle/fluid/operators/jit/gen_base.h:31:23: note: overridden virtual function is here virtual const char* name() const = 0; ^ ``` test=develop	6 years ago
乔龙飞 Qiao Longfei	6e0e706198	Revert "cpu reduce mode did not need to broadcast params test=develop"	6 years ago
Qiao Longfei	97b143fb49	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into fix-cpu-broadcast ... test=develop	6 years ago
Qiao Longfei	ffd0d1d216	clean need_broadcast_var_ test=develop	6 years ago
Qiao Longfei	fbadd4b60c	follow comment test=develop	6 years ago
dzhwinter	04e9776aef	add details. test=develop	6 years ago
Qiao Longfei	c4ded17e8c	async mode support dist train	6 years ago
Qiao Longfei	84367cf8bc	support async mode in dist mode parallel executor	6 years ago
Qiao Longfei	e72637ddd2	ThreadedSSAGraphExecutor support num_iteration_per_run test=develop	6 years ago
Qiao Longfei	a7152613f7	Merge branch 'fix-cpu-broadcast' of ssh://github.com/jacquesqiao/Paddle into add-communicator	6 years ago
Qiao Longfei	76072261f8	fix compiler ... test=develop	6 years ago
Qiao Longfei	b99db0e2c2	cpu reduce mode did not need to broadcast test=develop	6 years ago
Qiao Longfei	5cf0092825	add more log and fix test_dist_base in multi_batch_merge_pass	6 years ago
Gabor Buella	4975a9050a	Tests - add some missing to_string calls ... ``` /home/tej/code/gbuella_paddle/paddle/fluid/framework/ir/seqpool_concat_fuse_pass_tester.cc:167:40: error: adding 'int' to a string does not append to the string [-Werror,-Wstring-plus-int] std::string prefix = "seqpool_op_" + i; ~~~~~~~~~~~~~~^~~ /home/tej/code/gbuella_paddle/paddle/fluid/framework/ir/seqpool_concat_fuse_pass_tester.cc:167:40: note: use array indexing to silence this warning std::string prefix = "seqpool_op_" + i; ^ & [ ] 1 error generated. ``` test=develop	6 years ago
Qiao Longfei	b1fe8d4570	add a check for async_ssa_graph_exe test=develop	6 years ago
Qiao Longfei	16af1dbc7b	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into add-async-ssa-graph-executor ... test=develop	6 years ago
dzhwinter	4ef34916a4	enhanced print message. test=develop	6 years ago
dzhwinter	ce0394bcd0	merge develop branch. test=develop	6 years ago
dzhwinter	cca71532eb	add skip send.recv test=develop	6 years ago
dzhwinter	9f001c6525	skip dist. test=develop	6 years ago
dzhwinter	2561a6fc59	follow comment. test=develop	6 years ago
dzhwinter	2a5ecb68b0	follow comment. test=develop	6 years ago
dzhwinter	e537634d16	delete graph print pass. test=develop	6 years ago
dzhwinter	5cab99a686	fuck windows. rerun windows ci. test=develop	6 years ago
dzhwinter	0a63234c85	follow comments. test=develop	6 years ago
dzhwinter	9e87fbebb7	rerun windows ci. test=develop	6 years ago
dzhwinter	32a2014939	refine build strategy. test=develop	6 years ago
dzhwinter	8156fedf56	merge develop branch. test=develop	6 years ago
Qiao Longfei	02dab46ab8	add some debug info	6 years ago
dzhwinter	ee3aae56cd	merge develop branch. test=develop	6 years ago
dzhwinter	d6d3e6afe2	add more skip strategy	6 years ago
Qiao Longfei	be738a646e	add some debug infor	6 years ago
dzhwinter	2739096eec	compatibable with python side mem_opt	6 years ago
Qiao Longfei	a66115bed5	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into add-async-ssa-graph-executor ... test=develop	6 years ago
Qiao Longfei	fab8457e6b	code optimize	6 years ago
gongweibao	d303270a0e	revert test=develop (#15535)	6 years ago
Qiao Longfei	ada43e89c3	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into add-async-ssa-graph-executor ... test=develop	6 years ago
gongweibao	d54494ba87	cleanup test=develop (#15347)	6 years ago
sneaxiy	ef788603d4	merge develop ... test=develop	6 years ago
sneaxiy	d8568acd19	turn on remove_unnecessary_lock ... test=develop	6 years ago
sneaxiy	eac5a0aa0c	Merge develop ... test=develop	6 years ago
WangZhen	3ce6172052	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into graph_quantization	6 years ago
dzhwinter	8f3b252392	squash commits. test=develop	6 years ago
Dun	9f8f0fc2d3	Memory optimization of depthwise conv op and group norm op (#15313) ... * mem opt * test=develop * test=develop * test=develop * test=develop * test=develop * test=develop * test=develop * refine code test=develop * refine code test=develop * refine code test=develop * refine code test=develop * refine with cub test=develop * fix mkldnn test && remove comments && test=develop * polish code && test=develop * add only_forward test && test=develop	6 years ago
WangZhen	e2ff300b02	add UT for quantization.	6 years ago
WangZhen	451896fce4	init quantization.	6 years ago
Qiao Longfei	88d71fa2f9	support num_iteration_per_run	6 years ago
gongweibao	7cd4dd7ce4	Hide varhandle members. (#15382)	6 years ago
Qiao Longfei	ea66979684	can run	6 years ago
Qiao Longfei	92a6c7a049	init async ssa executor	6 years ago
flame	fb63cd89d4	Add python ir graph API (#14917)	6 years ago
sneaxiy	594dc4d8f0	partial gc 1st version ... test=develop	6 years ago
minqiyang	68a07328fa	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into add_pyramid_dnn_support ... test=develop	6 years ago
minqiyang	4bfa110fd8	Add no lock optimize pass ... test=develop	6 years ago
chengduo	eabb2105fa	Refactor MultiDevSSAGraphBuilder (#15090) ... * Refactor ParallelExecutor test=develop * extract Reduce and AllReduce mode from MultiDevSSAGraphBuilder test=develop * Refactor MultiDevSSAGraphBuilder test=developt * Remove enable_data_balance test=develop * code refine test=develop * remove data balance test=develop * refine ScaleLossGradOp test=develop * remove uncessary file test=develop * code refine test=develop * modify function name test=develop * follow comments test=develop * add is_distribution field test=develop * set is_distribution test=develop * fix DistSSAGraphBuilder test=develop	6 years ago
Yancey1989	4ad9de74dd	disable sync nccl by default test=develop	6 years ago
Yancey1989	e65436103f	Merge branch 'develop' of github.com:PaddlePaddle/Paddle into parallel_graph_mode ... test=develop	6 years ago
Yancey1989	94c80347b6	update by comment	6 years ago
Wu Yi	227e0c4518	fix nccl2 mode startup test=develop (#15132)	6 years ago
Yancey1989	35cda13e9f	fix unittest test=develop	6 years ago