317 Commits (9587249442e1f29fb6996e2e036d39b7c0700028)

Author	SHA1	Message	Date
peizhilin	38715e6fd0	minor fix	6 years ago
minqiyang	53433d7f2e	Revert the changes of VLOG ... test=develop	6 years ago
chengduo	a94a7355f0	Refine the GraphNum check (#14144) ... * refine GraphCheck test=develop * fix ci fail test=develop	6 years ago
minqiyang	0c3227a523	Change the origin VLOG level to 10 times ... Fix code to support cpplint syntax check test=develop	6 years ago
Yu Yang	c28beb8a3c	test(Pe): add dry run tests for pe (#14254) ... Dry run tests will skip `Op.Run` and just perform job scheduling. It helps to analysis dead lock in PE. test=develop	6 years ago
Yu Yang	90d9e5aee8	feat(platform): lazy initialization of devicecontext in pool (#14067) ... * feat(platform): lazy initialization of devicecontext in pool Use std::async(deferer, []{...}) to lazy initialize DeviceContext in Pool test=develop * Add future includes test=develop	6 years ago
Qiao Longfei	d26ff8cb2d	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into cpu-for-1.1-merge-with-shape	6 years ago
Wu Yi	26200f2e42	[1.1] [project] train imagenet using large batch size (#13766) ... * fix nccl2 lars dist support * put lars in momentum op * add tests lars * fix ci * fix cpu kernel * soft warning * remove lars in test_recognize_digits.py * move to another op * add file * update api.spec test=develop * update test=develop * fix api.spec test=develop * wip * wip, finish grad merge ops * wip, finish graph build * wip test running * work on 1 gpu * workable version * update * fix tests * fuse broadcast op * fix compile failed * refine * add batch merge test mnist * fix CI test=develop * fix build * use independent bn params for batch merge test=develop * update api.spec * follow comments and for test * wip * refine tests test=develop * follow comments test=develop * remove startup bn modify test=develop * follow comments test=develop * fix merge test=develop	6 years ago
Qiao Longfei	641369f92b	Merge branch 'dist-table-do-not-init-on-trainer' of ssh://github.com/jacquesqiao/Paddle into cpu-for-1.1-merge	6 years ago
Wu Yi	9da9b1926b	[1.1] fix graph num hang (#14072) ... * fix graph num hang test=develop * re-enable tests test=develop * re-enable graph num check test=develop * fix multi device pass role check test=develop	6 years ago
Qiao Longfei	fad42fe7cc	broadcast handle not inited parameter	6 years ago
Xin Pan	726fd438cd	avoid blocking everyone ... please fix offline	6 years ago
chengduo	e943f4508b	add graph number check (#14025) ... test=develop	6 years ago
chengduozh	82d2903b63	Fix fast ParallelExe bug ... test=develop	6 years ago
sneaxiy	d3ed070e10	test=develop	6 years ago
sneaxiy	fb6201e93e	test=develop	6 years ago
sneaxiy	9606b37ce4	test=develop	6 years ago
chengduo	d6747a9ac2	make check_graph choosable (#13674) ... test=develop	6 years ago
chengduo	5175b3cb2b	Add GraphChecker (#13580) ... * add GraphNum test=develop * add graph number check in parallelExecutor test=develop * fix transformer_model bug test=develop * fix graph num	6 years ago
Xin Pan	36c2a9af27	pass builder allow cutomize pass in python.	7 years ago
chengduo	d402234ba8	Feature/op_fuse_pass (#12440) ... * Add Preface * Add demo code * Save file * Refine code * seems can work * use elementwise strategy * Use ElementwiseComputeEx * Add comments * extract functions from operator * Refine code * Follow comment * code refine * add op_fuse pass * add backward * code refine * use TopologySortOperations * follow comments * refine IsFusible * code enhance * fix op_fusion_pass * refine code * refine fuse_elemwise_act_op * adjust the input and output * refine logic * add intermediate_edge * disable inplace * follow comments * refine logic * follow comments * Remove the removable IntermediateOut * change strategy * code refine * enable fuse backward * code refine * code refine * rename unit test * follow comments	7 years ago
Xin Pan	a83a4fab5c	Merge pull request #13441 from panyx0718/ir2 ... simplify and hide bcast_params	7 years ago
Xin Pan	ec6ee0a293	simplify and hide bcast_params	7 years ago
sneaxiy	612e1a3155	modification	7 years ago
sneaxiy	d0b2453ecd	merge develop	7 years ago
sneaxiy	24ea39c4c6	feature/eager_delete_tensor	7 years ago
minqiyang	dc863aac7e	Add kids exists detection in Scope	7 years ago
minqiyang	681514e15f	Make all scope pointer to shared	7 years ago
yuyang18	05cadf1b24	Add FastExecutor	7 years ago
Xin Pan	626abfc33a	code clean up and renaming ... Reduce one level of inheritence.	7 years ago
Xin Pan	99c0c20468	add pass test	7 years ago
Xin Pan	ab72d28a5e	clean up and correctness check	7 years ago
Xin Pan	aa1085ddc5	all passes ... add doc	7 years ago
Xin Pan	e4d7d7ae8f	pass refactoring	7 years ago
Xin Pan	142e832d21	pass registration	7 years ago
Xin Pan	5b183557f3	graph viz pass	7 years ago
Xin Pan	c3f6e0e8a2	add namespace to Graph	7 years ago
Xin Pan	64eaa4c829	clean	7 years ago
Xin Pan	2fa8df1caf	separate graph building pass and graph-based pe builder	7 years ago
Xin Pan	9605fcd124	all graphs	7 years ago
Xin Pan	af79b19207	add a simple program to graph	7 years ago
Xin Pan	68aa500451	polish attrs	7 years ago
Yancey	0042ba93c8	Merge pull request #12127 from Yancey1989/enforce_rpc_timeout ... Enforce rpc timeout	7 years ago
chengduo	325fbc4f1b	Add learning rate decay test (#12124) ... * Add learning rate decay test * fix test name * doesn't share @LR_DECAY_COUNTER@	7 years ago
chengduo	86b0a72576	Refine multi thread cpu parallel exe (#11406) ... * refine multi-thread CPU Parallel exe * refine multi thread CPU Parallel exe * Refine CPU version for ParallelExecutor * add share_parameter_between_cards_ * Fix ParallelExecutor bug * Fix unit test * Fix parameter opt balance * Fix with opti (param->grad) * Add grad to op var * Remove shard_param_between_cards	7 years ago
Yancey1989	d14afcedeb	polish function name	7 years ago
Yancey1989	1effba3312	fix pe with cpu place	7 years ago
chengduo	8d76cf397d	Fix TensorCopy bug (#11822) ... * Fix tensorcopy bug * follow comment * Refine TensorCopy	7 years ago
chengduo	6711b7b5f1	fix FeedAndSplitTensorIntoLocalScopes (#11817)	7 years ago
yi.wu	8d04d0e2a3	update	7 years ago
yi.wu	6f0107126a	fix broadcast bug	7 years ago
yi.wu	8e48c77b54	wip	7 years ago
yi.wu	3d69a82b83	fix dist train broadcasting bug	7 years ago
fengjiayi	964f515e9a	fix mac compile	7 years ago
Yancey1989	7e6518e8ca	fix compile warning	7 years ago
Yancey1989	7d1b146939	Merge branch 'develop' of github.com:PaddlePaddle/Paddle into overlap_memcpy_with_dist	7 years ago
Qiyang Min	046bb5c8cb	Fix NCCLBcast hang up bug in Parallel Executor (#11377) ... * 1. Create buddy allocator in each places before NcclBcast the variables 2. Check the memory usage of ALL gpus rather than the first one * 1. Make NCCLGroupGuard guards only the ncclBcast part, which avoid ncclGroupEnd blocking the exception throwing 2. NOTE the usage of NCCLGroupGuard * Remove the memory usage check of gpus * Fix code style	7 years ago
Yancey1989	6d752bafd8	use get_appropriate_dev to schedule rpc op	7 years ago
Yancey1989	4444e79e46	Merge branch 'develop' of github.com:PaddlePaddle/Paddle into overlap_memcpy_with_dist	7 years ago
chengduoZH	173d72b481	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into enable_cpu_on_pe	7 years ago
chengduoZH	aadaadf735	replace use_event with use_cuda, because use_event means the program running with CUDA, so use_cuda maybe more intuitive.	7 years ago
chengduoZH	1e731f5964	small fix	7 years ago
chengduoZH	5a3c8bf813	fix in c++ side	7 years ago
chengduoZH	0c851cab22	add SSA graph checker	7 years ago
Yancey1989	d5a88b9340	Merge branch 'develop' of github.com:PaddlePaddle/Paddle into overlap_memcpy_with_dist	7 years ago
chengduoZH	8291b916d6	replace graph_builder_factory with ssa_graph_builder_factory	7 years ago
Yancey1989	23433def4b	Merge branch 'develop' of github.com:PaddlePaddle/Paddle into overlap_memcpy_with_dist	7 years ago
yuyang18	d9af153232	SSA Graph Builder Factory ... * Use Builder Chain to decorate new builders. It is easy to extend builders. * Make graphviz path as a build strategy, not a FLAGS.	7 years ago
Yancey1989	e533a4b4ab	Merge branch 'develop' of github.com:PaddlePaddle/Paddle into overlap_memcpy_with_dist	7 years ago
Yancey1989	cb3861538d	fix compile failed with CPU	7 years ago
Yancey1989	93401c98e1	overlap rpc op memcpy in distributed training	7 years ago
yuyang18	86a61c177f	Add ScopeBufferedSSAGraphExecutor	7 years ago
yuyang18	7c777dd549	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into feature/exec_strategy	7 years ago
yuyang18	08295f9877	Add build strategy	7 years ago
yuyang18	e5281b3c2d	Clean code & add execution strategy	7 years ago
typhoonzero	928418a9ac	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into gen_nccl_id_op	7 years ago
typhoonzero	f5840d8925	follow comments	7 years ago
chengduoZH	97cb5479ae	change PE strategy	7 years ago
typhoonzero	a529d790b6	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into gen_nccl_id_op	7 years ago
typhoonzero	d9320dcd94	complete code	7 years ago
chengduoZH	c891189568	update sparse gradient parameter with reduce and broadcast	7 years ago
chengduoZH	5ff1ef36ee	update sparse parameter	7 years ago
yangyaming	82571deb89	Change `customize_loss_grad` to `use_default_grad_scale`.	7 years ago
Yu Yang	54ada9449e	Add demo for recordio train/test and parallel executor	7 years ago
Yu Yang	7a395881d4	Add customize_loss_grad option to PE	7 years ago
Yu Yang	5305c5f845	Correctly implement destructor of ParallelExecutor	7 years ago
fengjiayi	fbe562478d	Merge pull request #9994 from reyoung/feature/debug ... Fix bugs in local_scopes	7 years ago
Yu Yang	06fb055a2f	New group	7 years ago
Yu Yang	71a2e6b73c	Reverse create var	7 years ago
Yu Yang	89728f8e66	update	7 years ago
Yu Yang	eb2e4eeade	Debug	7 years ago
Yu Yang	b4aaa00a8a	Polish logic of ParallelExecutor	7 years ago
Yu Yang	ad73b331c7	Eagerly drop local scope in iteration (#9838) ... * Eagerly drop local scope in iteration * Correct create var * Fix typo * Debug	7 years ago
fengjiayi	90084a25d2	Merge pull request #9743 from JiayiFeng/modify_readers_to_fit_parallel_executor ... Modify readers to fit the parallel executor	7 years ago
wanghaoshuang	19c1a68ee9	Fix lost of LoD while splitting tensor in parallel executor.	7 years ago
JiayiFeng	ee178d5aeb	fix bugs	7 years ago
chengduoZH	7e7611d067	when the number of samples of current batch is less than the count of devices, let it crash.	7 years ago
qingqing01	2b7e5bd366	Support testing during training by ParallelExecutor. (#9738) ... * Support testing during training by ParallelExecutor. * Add unit test. * Improve the interface. * Follow comments.	7 years ago
Xin Pan	4bbfa9eccb	Add feed to ParallelExecutor	7 years ago
Xin Pan	b123ce88a1	Add enable/disable for delayed ops	7 years ago
Xin Pan	d0ac92531d	Improve ParallelExecutor performance	7 years ago
qiaolongfei	9a101cfc08	clean code	7 years ago
qiaolongfei	997e9a1fd2	fix mac compile	7 years ago
chengduoZH	60d0a0594e	refine parallel	7 years ago
Yu Yang	3aa2a8ffcf	Follow comments	7 years ago
Yu Yang	02aaecca35	Fix CPU compile	7 years ago
Yu Yang	edfd741e3a	Add simple python wrapper for ParallelExecutor	7 years ago
Yu Yang	a7b0d5bd26	Clean code	7 years ago
Yu Yang	e3144393e3	Extract Executors to indie modules	7 years ago
Yu Yang	c70b60dd70	Make executor steal graph inside	7 years ago
Yu Yang	4c3361cda8	Extract GraphExecutor	7 years ago
Yu Yang	b123e43bf9	extract multi devices graph builder	7 years ago
Yu Yang	dd73d18bb7	Extract SSAGraph	7 years ago
Yu Yang	79989c9025	Add SSA builder	7 years ago
Yu Yang	64d7a30271	Extract SSAGraph	7 years ago
Yu Yang	8dec4ad7a1	Use int not Place for vars	7 years ago
Yu Yang	3181501013	Rerange code	7 years ago
Yu Yang	f28ae6e4b1	Reorganize Code	7 years ago
Yu Yang	5c333e4143	Add dctor for dev_ctx	7 years ago
Yu Yang	15f5f10ed5	AddInput/AddOutput for OpHandle	7 years ago
Yu Yang	5368e50d84	Reorganize code	7 years ago
Yu Yang	fe7ed285d1	Extract NCCLCtxMap	7 years ago
Yu Yang	6ebc6bf533	ReorganizeCode	7 years ago
Yu Yang	a478a11e0b	NCCL Guard for bcast	7 years ago
Yu Yang	f2685bed81	Clean code	7 years ago
Yu Yang	41ad632341	Add NCCL Group Guard	7 years ago
Yu Yang	99fe83a020	Move nccl helper	7 years ago
Yu Yang	90f980167d	Do not wait computation stream	7 years ago
Yu Yang	7ac969b88c	Debug ... * add Check align * Make FetchData not shared_ptr * Remove FetchData * Wait & Fetch Data	7 years ago
Yu Yang	599f7a87ba	Refine code	7 years ago
Yu Yang	43e54079a8	Debug code	7 years ago
Yu Yang	e335f01826	Add more logs	7 years ago
Yu Yang	82693e7227	Wait nccl all reduce	7 years ago
Yu Yang	eb0a580e78	Add enforce	7 years ago
Yu Yang	65bc7d17d5	Add mtx to ncclAllReduce	7 years ago
Yu Yang	ba227df941	Expose num_threads	7 years ago
Yu Yang	1533bf12df	Use event and single thread	7 years ago
Yu Yang	95a0d7c7c1	Illegal memory access	7 years ago
Yu Yang	798e6907b4	Change mem order	7 years ago
Yu Yang	1c2b6100b0	Add	7 years ago
Yu Yang	4e43b71377	Add wait log	7 years ago
Yu Yang	dbed123382	Debug	7 years ago
Yu Yang	e53b6aba63	Use no thread	7 years ago
Yu Yang	a8bd7b9809	Add log	7 years ago
Yu Yang	3c9cea597e	Add more log	7 years ago
Yu Yang	f8f1a963d9	Add debug code	7 years ago
Yu Yang	fbbcedda01	Fix bug	7 years ago
Yu Yang	7643c2cbab	Add flag for use event	7 years ago
Yu Yang	ca4b3d2532	Use 12 threads	7 years ago
Yu Yang	f251a58e85	Use base class manage events	7 years ago