265 Commits (59c049995e036f80fc7e068a432037a9c8a4a014)

Author	SHA1	Message	Date
Qiao Longfei	63cd70a8b8	fix blocking problem	6 years ago
Qiao Longfei	3225e19591	fix remove recv op	6 years ago
Qiao Longfei	446fdf9563	fix compile problem	6 years ago
Qiao Longfei	a23f1ee85a	optimize code	6 years ago
Qiao Longfei	7d5dc4ef06	fix cmake list	6 years ago
Qiao Longfei	255b36dad2	can run	6 years ago
Qiao Longfei	8c38aca954	tmp commit	6 years ago
Qiao Longfei	13e8b5bf89	clear gradient before merge	6 years ago
Qiao Longfei	50601501e5	improve communicator	6 years ago
Qiao Longfei	c2cce6bafa	simplify parameter send and recv	6 years ago
Qiao Longfei	3c6b733d14	remove exe context	6 years ago
Qiao Longfei	9573d610ef	use rpc common in parameter send and recv	6 years ago
Qiao Longfei	3691a46fa3	improve communicator	6 years ago
Qiao Longfei	b8491bfd4e	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into add-communicator	6 years ago
Dun	a83e470405	Profiler refine and add CUDA runtime api tracer (#15301) ... * refine profiler && add runtime tracer * test=develop * test=develop * test=develop * test=develop * test=develop * test=develop * test=develop * test=develop * fix bug && test=develop * add thread id map && test=develop * test=develop * testing * bug fix * remove cuda event && refine code && test=develop * test=develop * test=develop * test=develop * fix windows temp file && test=develop * test=develop * fix windows bug && test=develop * fix start up issue && test=develop * code polish && test=develop * remove unused code && test=develop * add some cupti cbid && test=develop * add FLAGS_multiple_of_cupti_buffer_size && test=develop * fix compile error && test=develop * add keyword && test=develop * fix && test=develop * code polish && test=develop	6 years ago
Qiao Longfei	a804a2ae2a	complete parameter recv	6 years ago
Qiao Longfei	a0585d08ed	init parameter recv	6 years ago
Qiao Longfei	5c36eb8b69	fix build	6 years ago
Qiao Longfei	4356f186b4	complete parameter_send	6 years ago
Qiao Longfei	741b7cfda9	fix compile test=develop	6 years ago
Qiao Longfei	381f383989	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into add-communicator	6 years ago
Qiao Longfei	657a4f9430	code can compile	6 years ago
Qiao Longfei	c7e3868007	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into add-communicator	6 years ago
sneaxiy	ba4f43fd62	fix compile error in distributed mode ... test=develop	6 years ago
乔龙飞 Qiao Longfei	5f89ce7fcd	Merge pull request #15536 from jacquesqiao/fix-prefetch-one-parameter ... Fix prefetch one parameter	6 years ago
Qiao Longfei	806658d72b	add space after colon in commnet test=develop	6 years ago
Qiao Longfei	4d13434443	fix a little problem test=develop	6 years ago
Qiao Longfei	9c3910f390	IncreaseBatchBarrier should be in the right condition test=develop	6 years ago
Qiao Longfei	5a0c6593d5	revert RequestGetHandler	6 years ago
gongweibao	d54494ba87	cleanup test=develop (#15347)	6 years ago
Qiao Longfei	84220765a7	refine code, add more log	6 years ago
Qiao Longfei	c750be6d9d	add some log	6 years ago
gongweibao	fe8f28c957	Add GetVariableNoBarrier on brpc. (#15488)	6 years ago
Qiao Longfei	74040cb4aa	code clean	6 years ago
Qiao Longfei	1866d2dbef	parameter send support selected_rows	6 years ago
Qiao Longfei	ca5d96bb3d	complete send lod tensor	6 years ago
Qiao Longfei	be72940b76	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into add-communicator	6 years ago
tangwei12	8b50ad80ff	checkpoint at distributed training (#14854) ... checkpoint for distributed training.	6 years ago
gongweibao	f4dec5cdee	Check collective server's data. (#15449)	6 years ago
gongweibao	7f8b40f68d	Fix brpc complation error. (#15451)	6 years ago
gongweibao	7ab4af2716	Fix brpc compilation. (#15417)	6 years ago
Wu Yi	7e651a38dd	fix mac cmake version 3.13 build (#15386) ... * fix mac cmake version 3.13 test=develop * fix again test=develop	6 years ago
Qiao Longfei	b5aefc8b6d	fix compile problem	6 years ago
Qiao Longfei	9958775b31	add NewTmpScope to scope	6 years ago
Yiqun Liu	f413b6892b	Revert the modification of while_op in #14764. (#15372) ... * Revert the modification of while_op in #14764. test=develop * Remove the dependency of GRPC_DEPS. test=develop	6 years ago
Yiqun Liu	568cc2ffa8	Optimize while_op for test (#14764) ... * Simplify the compare op for CPU. * Use asynchronous tensor copy in reshape_op's kernel. * Optimize while_op for test, avoiding creating variables every time. test=develop * Enable the cache of kernel type and kernel function. test=develop * Enable profiling with gperftools. * Remove flags for testing, and fix the linking error. test=develop * Delete the codes of ChooseKernel. test=develop * Fix bug when preparing ExecutorPrepareContext for while_op. * Fix missing depending on grpc libraries. * Remove the redundant print. test=develop * Follow comments. * Remove the codes related to prepare the ExecutorPrepareContext for while_op. test=develop	6 years ago
乔龙飞 Qiao Longfei	e1679b8847	Merge pull request #14893 from JiabinYang/feature/add_prefech_hs ... Feature/add prefech hs	6 years ago
gongweibao	ce70229ba6	Add max_body_size flags to brpc (#15084)	6 years ago
Wu Yi	a8bc05b5ff	Refactor distributed RPC (#15075) ... * wip * wip * refactor no.1 dir structure test=develop * fix linking test=develop * fix includes test=develop * fix build test=develop * fix build test=develop	6 years ago
minqiyang	8ec3d863b0	Fix throw_on_error direct call bug ... test=develop	6 years ago
JiabinYang	1bec52f581	test=develop, fix cpu running error	6 years ago
Wang Guibao	e7675dd542	Avoid calling VLOG() when program exiting (#14937) ... * Avoid calling VLOG() when program exiting test=develop * Avoid calling VLOG() when program exiting test=develop	6 years ago
JiabinYang	bfcb5e5235	test=develop, fix gpu compile error on prefetch, and fix hs/nce ut failed on gpu	6 years ago
JiabinYang	4877f5d71f	test=develop, fix compile error under gpu mode	6 years ago
JiabinYang	8515ee3a29	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into feature/add_prefech_hs	6 years ago
gongweibao	b849157e9d	Add size enforce (#14919)	6 years ago
JiabinYang	3b7b2e1ded	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into feature/add_prefech_hs	6 years ago
JiabinYang	656040c726	merge reyoung optimization	6 years ago
gongweibao	addded48e1	test=develop (#14898)	6 years ago
Yu Yang	bacf1d2399	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into feature/tensor_type	6 years ago
gongweibao	0b1c7d838c	Add brpc serialization support. (#11430)	6 years ago
JiabinYang	50fce87905	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into feature/add_prefech_hs	6 years ago
Yu Yang	194e66f785	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into feature/tensor_type	6 years ago
JiabinYang	c2e851f7b2	test=develop, remove sparse bias and add prefetch and related tests	6 years ago
Yu Yang	c00e07cda0	Fix distribute compile ... test=develop	6 years ago
Qiao Longfei	1870262ba9	pserver should crash early whe has problem ... test=develop	6 years ago
JiabinYang	c35fdf1581	Merge branch 'add_prefetch_in_nce' of https://github.com/seiriosPlus/Paddle into feature/add_prefech_hs	6 years ago
tangwei12	33a004a779	fix numel nce and prefetch	6 years ago
tangwei12	57557f6774	fix scope in nce and prefetch	6 years ago
tangwei12	bb2e7f0bbe	add scope in prefetch	6 years ago
gongweibao	f1fb64b17f	Add reduce sparse tensor feature. (#14757)	6 years ago
tangwei12	527946df49	add scope in prefetch	6 years ago
Wang Guibao	41e19eb431	AsyncExecutor (#14627) ... * AsyncExecutor: C++ side * Google naming conventions * Rename MultiExecutor to AsyncExecutor * pybind with async_executor * Naming convention * remove some flags and unused code * add refactored file of async_executor and data_feed * clear async executor interface and add data feed factory * split async executor into executor_thread_worker and async_executor, refactor pybind, add datafeed and corresponding proto * Fix async_executor interfaces: 1) Remove all protobufs; 2) Stop after each epoch * refine async_executor_refactor.cc * add some files about datafeed * Revert "add some files about datafeed" This reverts commit 8ee8133ab841196925a2812b76f18d2812a6701d. * Interface rework * add MultiSlotDataFeed * Creating DataFeedDesc from .proto file, then manipulate it (add/del fields etc) from python side * update data_feed for add MultiSlotDataFeed * update datafeed and async_executor to run bow_net demo * fix bug that finish_set_filelist failed in multithread * delete finish_binding_memory_(flag), because it can not be marked under the current interface * Fix bug * update async_executor.py for support set_use_slots * update async_executor.py for support set_use_slots and set set_dense_slots * fix bug that when the number of files is less than the number of threads, it will fetch nan * remove redundant code, and make executor exit when set a illegal queue size * add batch_size check * add MultiSlotDesc * Revert "add MultiSlotDesc" This reverts commit 2e72ebfad364ed6b5dcc75f38ffb2a1fdec83d8e. * add some checkpoint in DataFeedDesc * add CheckFile function in MultiSlotDataFeed * update something error info * fix deaded lock bug * Fix fetch variable * Merge error * fix code style in async_executor * using one lock blocking queue replace two lock blocking queue because of some bugs * update code style * add utest for data_feed * Fix fetch var * update utest for data_feed for multithread * update SetFileList info * fix bug in utest of data_feed * Add comments for python * Add comments for python code * Fix pybind.cc with new pybind11 version * add note for DataFeedDesc's set_use_slots function * Add save_model * update data_feed_test for multi-type * add comment for executor_thread_worker * Remove unused code * update data_feed_test for generate test data file * removed unnecessary interfaces and add comments * c++ style check * update data_feed.cc * AsyncExecutor: C++ side Google naming conventions Rename MultiExecutor to AsyncExecutor pybind with async_executor Naming convention remove some flags and unused code add refactored file of async_executor and data_feed clear async executor interface and add data feed factory split async executor into executor_thread_worker and async_executor, refactor pybind, add datafeed and corresponding proto Fix async_executor interfaces: 1) Remove all protobufs; 2) Stop after each epoch refine async_executor_refactor.cc add some files about datafeed Revert "add some files about datafeed" This reverts commit 8ee8133ab841196925a2812b76f18d2812a6701d. add MultiSlotDataFeed Interface rework Creating DataFeedDesc from .proto file, then manipulate it (add/del fields etc) from python side update datafeed and async_executor to run bow_net demo update async_executor.py for support set_use_slots Fix bug update async_executor.py for support set_use_slots and set set_dense_slots fix bug that when the number of files is less than the number of threads, it will fetch nan remove redundant code, and make executor exit when set a illegal queue size add MultiSlotDesc Revert "add MultiSlotDesc" This reverts commit 2e72ebfad364ed6b5dcc75f38ffb2a1fdec83d8e. add some checkpoint in DataFeedDesc Fix fetch variable fix code style in async_executor Fix fetch var add utest for data_feed Add comments for python update utest for data_feed for multithread fix bug in utest of data_feed Add comments for python code Fix pybind.cc with new pybind11 version add note for DataFeedDesc's set_use_slots function update data_feed_test for multi-type Add save_model update data_feed_test for generate test data file removed unnecessary interfaces and add comments add comment for executor_thread_worker Remove unused code update data_feed.cc c++ style check * commit for code style * commit for code style * commit for code style * commit for code style * Comment away __init__ in async_executor.py * clang-format fix test=develop * use PADDLE_THROW instead of exit(-1); use unique_ptr to manage scope var in data_feed_test.cc * commit for update code style * commit for update code style * Add async_executor demo; Remove some methods test=develop * commit for update code style * commit for update code style * commit for update code style * update API.spec * AsyncExecutor test=develop * AsyncExecutor test=develop * AsyncExecutor test=develop * AsyncExecutor test=develop * Fix API.spec test=develop * Fix API.spec test=develop * Fix windows build error test=develop * FIx windows build error test=develop * FIx windows build error test=develop * FIx windows build error test=develop * Fix Windows Build test=develop * Fix Windows Build test=develop * Fix Windows Build test=develop * Fix code style test=develop * Fix code style test=develop * update datafeed * Fix code style test=develop * update data_feed_test for test Tensor test=develop * Fix code style test=develop * Fix windows build failure test=develop * Fix code style and windows build failure test=develop * Fix PYTHON3.5 build failure test=develop * AsyncExecutor API test=develop	6 years ago
Qiao Longfei	3e45a5a5ec	lookup_table gpu kernel support prefetch ... test=develop	6 years ago
Qiao Longfei	3a3cfc2d8d	prefetch support gpu ... test=develop	6 years ago
Qiao Longfei	d32de7e6e1	fix code format test=develop	6 years ago
Qiao Longfei	5a660aee7d	update log level in parameter prefetch test=develop	6 years ago
Qiao Longfei	8ebde595c9	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into refactor-prefetch ... test=develop	6 years ago
Qiao Longfei	40f68b1349	unit test ready	6 years ago
Qiao Longfei	97cbec9b74	clean code	6 years ago
Qiao Longfei	9589babe12	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into refactor-prefetch ... test=develop	6 years ago
Qiao Longfei	d98c59fd2c	support none sliced variable	6 years ago
minqiyang	be04d99fe4	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into revert_vlog ... test=develop	6 years ago
Qiao Longfei	af2f5fc824	fix some bugs	6 years ago
minqiyang	53433d7f2e	Revert the changes of VLOG ... test=develop	6 years ago
Qiao Longfei	ed9fa4b301	can run	6 years ago
Qiao Longfei	686d15c8e0	update grpc_variable_response	6 years ago
peizhilin	36cd18b549	Merge remote-tracking branch 'upstream/develop' into windows/build	6 years ago
Qiao Longfei	d827881502	fix pserver and prefetch rpc	6 years ago
Qiao Longfei	5856c2f332	change Var to FindVar	6 years ago
gongweibao	c1bf9664cd	Add options to disable SO_REUSEPORT of grpc. (#14269)	6 years ago
Qiao Longfei	4ad5fd8f54	add parameter prefetch	6 years ago
Qiao Longfei	9d276fe8a8	add parameter prefetch	6 years ago
Qiao Longfei	9851a53478	add prefetch part in pserver	6 years ago
peizhilin	7c8c9dc9bf	fix unit test cases	6 years ago
sneaxiy	d231e55065	merge develop ... test=develop	6 years ago
minqiyang	0c3227a523	Change the origin VLOG level to 10 times ... Fix code to support cpplint syntax check test=develop	6 years ago
Yu Yang	057a682ee9	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into rewrite_allocation	6 years ago
Qiao Longfei	3b8dd9ebbd	optimize code test=develop	6 years ago
Qiao Longfei	59fbfbfbf7	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into optimize-pserver-profiler-thread-pool ... test=develop	6 years ago
Qiao Longfei	9e4e9e9b6e	clean rpc server profiler	6 years ago
Wu Yi	306236c2c0	feature/DC asgd (#12722) ... * wip * add ref_by_trainer_id op * ready to test * fix ref inputs * refine rpc_op_handle * fix merge bug	6 years ago
Yu Yang	8310ce6007	Fix cluster memory ... test=develop	6 years ago
Yu Yang	71c846ef8a	Revert buggy changes ... test=develop	6 years ago
Yu Yang	dbf9f6f408	Fix distribute compile ... test=develop	6 years ago
gongweibao	58c027cc38	Add rpc profiler flags. (#13989) ... Add rpc profiler flags	6 years ago
gongweibao	a831ecc75d	Add grpc error context. (#13957) ... Add grpc error context	6 years ago
gongweibao	078223b3e3	Add rpc timeline. (#13900) ... Add rpc timeline	6 years ago
Xin Pan	642905958a	fix compile error ... test=develop	6 years ago
Xin Pan	33b68fdf25	fix compile error ... test=develop	6 years ago
Xin Pan	6746b1fdf3	add missing header ... test=develop	6 years ago
Xin Pan	5fb72d840a	add header ... test=develop	6 years ago
Wu Yi	29c63d180f	[Feature] dist op role and lr op role, to support memory optimize with dist training (#13220) ... * wip * clean up * should fix running with memopt * add ut * mark lr schedule op role * hide lr_schedule_guard * use op_role_var instead of ufind * unify dist test name * wip for py3 support * fix var deref * fix python3 mem_opt order * remove comments	6 years ago
gongweibao	239a83860b	Fix VarHandle return bug. (#13354)	7 years ago
Wu Yi	437debf40e	Fix mac ci dist (#13393)	7 years ago
Qiyang Min	f00081a419	Merge pull request #13381 from velconia/make_mac_pass_build ... fix redundant args of lambda and remove exception of destructor	7 years ago
velconia	bb9ec4b25f	Polish code	7 years ago
gongweibao	3a3f28f99b	add (#13377)	7 years ago
velconia	926f5f43a9	fix redundant args of lambda and remove exception of destructor	7 years ago
gongweibao	8cee9f6176	Fix rpcclient's wait action in aync env. (#13307)	7 years ago
Yancey1989	6edfae4234	reset received vars on pserver	7 years ago
Qiao Longfei	cdd14f17f1	fix async mode handle COMPLETE_MESSAGE (#13212)	7 years ago
qiaolongfei	fcf20eed0f	fix sparse update bug	7 years ago
tangwei12	9f11db4080	add todo in impl	7 years ago
tangwei12	bb9f494740	merge develop	7 years ago
Qiao Longfei	653fad08f8	Optimize selected rows for dist lookup table with pthread rwlock (#12635) ... Optimize selected rows for dist lookup table with rwlock	7 years ago
gongweibao	d06849305a	parameter dispather. (#12666)	7 years ago
tangwei12	59580a7f69	bug fix	7 years ago
qiaolongfei	c0890988da	add RPCServerProfiler, replace listen and serv optimizer	7 years ago
Qiyang Min	7da453630e	Merge pull request #12403 from velconia/fix_hang_up ... Fix grpc destroy bug	7 years ago
chengduo	2409d0f710	Refine regularization for selected_rows (#12369) ... * refine regularization for selected_rows * clean lookup_table * refine rpc_server_test * temporally disable rpc_server_test * fix rpc_server_test * add unit test	7 years ago
minqiyang	053540e199	Add volatile to stopped_ member	7 years ago
minqiyang	b78ffde6d5	Add stopped sign for grpc client	7 years ago
Yancey1989	fb06ed7bdc	Merge branch 'develop' of github.com:PaddlePaddle/Paddle into rpc_complete_interface	7 years ago
Qiao Longfei	95a2b5f56a	fix mac build of sendrecvop_utils (#12272)	7 years ago
Yancey1989	d4f51218ef	Merge branch 'develop' of github.com:PaddlePaddle/Paddle into rpc_complete_interface	7 years ago
gongweibao	3a6213f493	Change grpc interface to compatible with brpc. (#12164)	7 years ago
Yancey1989	efd5a84986	update executor interface	7 years ago
Yancey1989	d0771cf912	update	7 years ago
Yancey1989	7570d8e77c	add rpc complete interface	7 years ago
Yancey1989	4a91a14549	enforce rpc client timeout	7 years ago
minqiyang	2c4fb585db	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into fix_grpc_destroy_bug	7 years ago
minqiyang	0d04545e9c	Remove debug info	7 years ago
minqiyang	207d1b81fe	Add fixed grpc	7 years ago
dzhwinter	4ed0b62476	Move fluid::framework::InitDevices into fluid::platform (#11757) ... * move to platform * "move init from framework to platform" * "remove used init" * "fix ci" * "fix ci" * "fix generic" * "fix ci" * "fix ci" * "fix ci" * "disable fragile test"	7 years ago
minqiyang	1d6ecd3c4e	Change grpc version to 1.13.x	7 years ago
Yancey1989	37410a0c75	update by comment	7 years ago
Yancey1989	029425a5f4	update	7 years ago
Yancey1989	c1ab215e26	Merge branch 'develop' of github.com:PaddlePaddle/Paddle into dist_pass_barrier	7 years ago
Yancey1989	1366832a41	add dist pass barrier	7 years ago