218 Commits (b34933d9ee3b61dbbd642fd02f244c36d0d14550)

Author	SHA1	Message	Date
Qiao Longfei	43378ad626	add flags to init	6 years ago
Qiao Longfei	ad5a2b3edf	add some debug flags for communicator	6 years ago
Qiao Longfei	0a828fef82	add some flags for communicator	6 years ago
Qiao Longfei	63cd70a8b8	fix blocking problem	6 years ago
Qiao Longfei	3225e19591	fix remove recv op	6 years ago
Qiao Longfei	446fdf9563	fix compile problem	6 years ago
Qiao Longfei	a23f1ee85a	optimize code	6 years ago
Qiao Longfei	7d5dc4ef06	fix cmake list	6 years ago
Qiao Longfei	255b36dad2	can run	6 years ago
Qiao Longfei	8c38aca954	tmp commit	6 years ago
Qiao Longfei	13e8b5bf89	clear gradient before merge	6 years ago
Qiao Longfei	50601501e5	improve communicator	6 years ago
Qiao Longfei	c2cce6bafa	simplify parameter send and recv	6 years ago
Qiao Longfei	3c6b733d14	remove exe context	6 years ago
Qiao Longfei	9573d610ef	use rpc common in parameter send and recv	6 years ago
Qiao Longfei	3691a46fa3	improve communicator	6 years ago
Qiao Longfei	b8491bfd4e	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into add-communicator	6 years ago
Dun	a83e470405	Profiler refine and add CUDA runtime api tracer (#15301) ... * refine profiler && add runtime tracer * test=develop * test=develop * test=develop * test=develop * test=develop * test=develop * test=develop * test=develop * fix bug && test=develop * add thread id map && test=develop * test=develop * testing * bug fix * remove cuda event && refine code && test=develop * test=develop * test=develop * test=develop * fix windows temp file && test=develop * test=develop * fix windows bug && test=develop * fix start up issue && test=develop * code polish && test=develop * remove unused code && test=develop * add some cupti cbid && test=develop * add FLAGS_multiple_of_cupti_buffer_size && test=develop * fix compile error && test=develop * add keyword && test=develop * fix && test=develop * code polish && test=develop	6 years ago
Qiao Longfei	a804a2ae2a	complete parameter recv	6 years ago
Qiao Longfei	a0585d08ed	init parameter recv	6 years ago
Qiao Longfei	5c36eb8b69	fix build	6 years ago
Qiao Longfei	4356f186b4	complete parameter_send	6 years ago
Qiao Longfei	741b7cfda9	fix compile test=develop	6 years ago
Qiao Longfei	381f383989	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into add-communicator	6 years ago
Qiao Longfei	657a4f9430	code can compile	6 years ago
Qiao Longfei	c7e3868007	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into add-communicator	6 years ago
sneaxiy	ba4f43fd62	fix compile error in distributed mode ... test=develop	6 years ago
乔龙飞 Qiao Longfei	5f89ce7fcd	Merge pull request #15536 from jacquesqiao/fix-prefetch-one-parameter ... Fix prefetch one parameter	6 years ago
Qiao Longfei	806658d72b	add space after colon in commnet test=develop	6 years ago
Qiao Longfei	4d13434443	fix a little problem test=develop	6 years ago
Qiao Longfei	9c3910f390	IncreaseBatchBarrier should be in the right condition test=develop	6 years ago
Qiao Longfei	5a0c6593d5	revert RequestGetHandler	6 years ago
gongweibao	d54494ba87	cleanup test=develop (#15347)	6 years ago
Qiao Longfei	84220765a7	refine code, add more log	6 years ago
Qiao Longfei	c750be6d9d	add some log	6 years ago
gongweibao	fe8f28c957	Add GetVariableNoBarrier on brpc. (#15488)	6 years ago
Qiao Longfei	74040cb4aa	code clean	6 years ago
Qiao Longfei	1866d2dbef	parameter send support selected_rows	6 years ago
Qiao Longfei	ca5d96bb3d	complete send lod tensor	6 years ago
Qiao Longfei	be72940b76	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into add-communicator	6 years ago
tangwei12	8b50ad80ff	checkpoint at distributed training (#14854) ... checkpoint for distributed training.	6 years ago
gongweibao	f4dec5cdee	Check collective server's data. (#15449)	6 years ago
gongweibao	7f8b40f68d	Fix brpc complation error. (#15451)	6 years ago
gongweibao	7ab4af2716	Fix brpc compilation. (#15417)	6 years ago
Wu Yi	7e651a38dd	fix mac cmake version 3.13 build (#15386) ... * fix mac cmake version 3.13 test=develop * fix again test=develop	6 years ago
Qiao Longfei	b5aefc8b6d	fix compile problem	6 years ago
Qiao Longfei	9958775b31	add NewTmpScope to scope	6 years ago
Yiqun Liu	f413b6892b	Revert the modification of while_op in #14764. (#15372) ... * Revert the modification of while_op in #14764. test=develop * Remove the dependency of GRPC_DEPS. test=develop	6 years ago
Yiqun Liu	568cc2ffa8	Optimize while_op for test (#14764) ... * Simplify the compare op for CPU. * Use asynchronous tensor copy in reshape_op's kernel. * Optimize while_op for test, avoiding creating variables every time. test=develop * Enable the cache of kernel type and kernel function. test=develop * Enable profiling with gperftools. * Remove flags for testing, and fix the linking error. test=develop * Delete the codes of ChooseKernel. test=develop * Fix bug when preparing ExecutorPrepareContext for while_op. * Fix missing depending on grpc libraries. * Remove the redundant print. test=develop * Follow comments. * Remove the codes related to prepare the ExecutorPrepareContext for while_op. test=develop	6 years ago
乔龙飞 Qiao Longfei	e1679b8847	Merge pull request #14893 from JiabinYang/feature/add_prefech_hs ... Feature/add prefech hs	6 years ago
gongweibao	ce70229ba6	Add max_body_size flags to brpc (#15084)	6 years ago
Wu Yi	a8bc05b5ff	Refactor distributed RPC (#15075) ... * wip * wip * refactor no.1 dir structure test=develop * fix linking test=develop * fix includes test=develop * fix build test=develop * fix build test=develop	6 years ago
minqiyang	8ec3d863b0	Fix throw_on_error direct call bug ... test=develop	6 years ago
JiabinYang	1bec52f581	test=develop, fix cpu running error	6 years ago
Wang Guibao	e7675dd542	Avoid calling VLOG() when program exiting (#14937) ... * Avoid calling VLOG() when program exiting test=develop * Avoid calling VLOG() when program exiting test=develop	6 years ago
JiabinYang	bfcb5e5235	test=develop, fix gpu compile error on prefetch, and fix hs/nce ut failed on gpu	6 years ago
JiabinYang	4877f5d71f	test=develop, fix compile error under gpu mode	6 years ago
JiabinYang	8515ee3a29	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into feature/add_prefech_hs	6 years ago
gongweibao	b849157e9d	Add size enforce (#14919)	6 years ago
JiabinYang	3b7b2e1ded	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into feature/add_prefech_hs	6 years ago
JiabinYang	656040c726	merge reyoung optimization	6 years ago
gongweibao	addded48e1	test=develop (#14898)	6 years ago
Yu Yang	bacf1d2399	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into feature/tensor_type	6 years ago
gongweibao	0b1c7d838c	Add brpc serialization support. (#11430)	6 years ago
JiabinYang	50fce87905	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into feature/add_prefech_hs	6 years ago
Yu Yang	194e66f785	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into feature/tensor_type	6 years ago
JiabinYang	c2e851f7b2	test=develop, remove sparse bias and add prefetch and related tests	6 years ago
Yu Yang	c00e07cda0	Fix distribute compile ... test=develop	6 years ago
Qiao Longfei	1870262ba9	pserver should crash early whe has problem ... test=develop	6 years ago
JiabinYang	c35fdf1581	Merge branch 'add_prefetch_in_nce' of https://github.com/seiriosPlus/Paddle into feature/add_prefech_hs	6 years ago
tangwei12	33a004a779	fix numel nce and prefetch	6 years ago
tangwei12	57557f6774	fix scope in nce and prefetch	6 years ago
tangwei12	bb2e7f0bbe	add scope in prefetch	6 years ago
gongweibao	f1fb64b17f	Add reduce sparse tensor feature. (#14757)	6 years ago
tangwei12	527946df49	add scope in prefetch	6 years ago
Wang Guibao	41e19eb431	AsyncExecutor (#14627) ... * AsyncExecutor: C++ side * Google naming conventions * Rename MultiExecutor to AsyncExecutor * pybind with async_executor * Naming convention * remove some flags and unused code * add refactored file of async_executor and data_feed * clear async executor interface and add data feed factory * split async executor into executor_thread_worker and async_executor, refactor pybind, add datafeed and corresponding proto * Fix async_executor interfaces: 1) Remove all protobufs; 2) Stop after each epoch * refine async_executor_refactor.cc * add some files about datafeed * Revert "add some files about datafeed" This reverts commit 8ee8133ab841196925a2812b76f18d2812a6701d. * Interface rework * add MultiSlotDataFeed * Creating DataFeedDesc from .proto file, then manipulate it (add/del fields etc) from python side * update data_feed for add MultiSlotDataFeed * update datafeed and async_executor to run bow_net demo * fix bug that finish_set_filelist failed in multithread * delete finish_binding_memory_(flag), because it can not be marked under the current interface * Fix bug * update async_executor.py for support set_use_slots * update async_executor.py for support set_use_slots and set set_dense_slots * fix bug that when the number of files is less than the number of threads, it will fetch nan * remove redundant code, and make executor exit when set a illegal queue size * add batch_size check * add MultiSlotDesc * Revert "add MultiSlotDesc" This reverts commit 2e72ebfad364ed6b5dcc75f38ffb2a1fdec83d8e. * add some checkpoint in DataFeedDesc * add CheckFile function in MultiSlotDataFeed * update something error info * fix deaded lock bug * Fix fetch variable * Merge error * fix code style in async_executor * using one lock blocking queue replace two lock blocking queue because of some bugs * update code style * add utest for data_feed * Fix fetch var * update utest for data_feed for multithread * update SetFileList info * fix bug in utest of data_feed * Add comments for python * Add comments for python code * Fix pybind.cc with new pybind11 version * add note for DataFeedDesc's set_use_slots function * Add save_model * update data_feed_test for multi-type * add comment for executor_thread_worker * Remove unused code * update data_feed_test for generate test data file * removed unnecessary interfaces and add comments * c++ style check * update data_feed.cc * AsyncExecutor: C++ side Google naming conventions Rename MultiExecutor to AsyncExecutor pybind with async_executor Naming convention remove some flags and unused code add refactored file of async_executor and data_feed clear async executor interface and add data feed factory split async executor into executor_thread_worker and async_executor, refactor pybind, add datafeed and corresponding proto Fix async_executor interfaces: 1) Remove all protobufs; 2) Stop after each epoch refine async_executor_refactor.cc add some files about datafeed Revert "add some files about datafeed" This reverts commit 8ee8133ab841196925a2812b76f18d2812a6701d. add MultiSlotDataFeed Interface rework Creating DataFeedDesc from .proto file, then manipulate it (add/del fields etc) from python side update datafeed and async_executor to run bow_net demo update async_executor.py for support set_use_slots Fix bug update async_executor.py for support set_use_slots and set set_dense_slots fix bug that when the number of files is less than the number of threads, it will fetch nan remove redundant code, and make executor exit when set a illegal queue size add MultiSlotDesc Revert "add MultiSlotDesc" This reverts commit 2e72ebfad364ed6b5dcc75f38ffb2a1fdec83d8e. add some checkpoint in DataFeedDesc Fix fetch variable fix code style in async_executor Fix fetch var add utest for data_feed Add comments for python update utest for data_feed for multithread fix bug in utest of data_feed Add comments for python code Fix pybind.cc with new pybind11 version add note for DataFeedDesc's set_use_slots function update data_feed_test for multi-type Add save_model update data_feed_test for generate test data file removed unnecessary interfaces and add comments add comment for executor_thread_worker Remove unused code update data_feed.cc c++ style check * commit for code style * commit for code style * commit for code style * commit for code style * Comment away __init__ in async_executor.py * clang-format fix test=develop * use PADDLE_THROW instead of exit(-1); use unique_ptr to manage scope var in data_feed_test.cc * commit for update code style * commit for update code style * Add async_executor demo; Remove some methods test=develop * commit for update code style * commit for update code style * commit for update code style * update API.spec * AsyncExecutor test=develop * AsyncExecutor test=develop * AsyncExecutor test=develop * AsyncExecutor test=develop * Fix API.spec test=develop * Fix API.spec test=develop * Fix windows build error test=develop * FIx windows build error test=develop * FIx windows build error test=develop * FIx windows build error test=develop * Fix Windows Build test=develop * Fix Windows Build test=develop * Fix Windows Build test=develop * Fix code style test=develop * Fix code style test=develop * update datafeed * Fix code style test=develop * update data_feed_test for test Tensor test=develop * Fix code style test=develop * Fix windows build failure test=develop * Fix code style and windows build failure test=develop * Fix PYTHON3.5 build failure test=develop * AsyncExecutor API test=develop	6 years ago
Qiao Longfei	3e45a5a5ec	lookup_table gpu kernel support prefetch ... test=develop	6 years ago
Qiao Longfei	3a3cfc2d8d	prefetch support gpu ... test=develop	6 years ago
Qiao Longfei	d32de7e6e1	fix code format test=develop	6 years ago
Qiao Longfei	5a660aee7d	update log level in parameter prefetch test=develop	6 years ago
Qiao Longfei	8ebde595c9	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into refactor-prefetch ... test=develop	6 years ago
Qiao Longfei	40f68b1349	unit test ready	6 years ago
Qiao Longfei	97cbec9b74	clean code	6 years ago
Qiao Longfei	9589babe12	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into refactor-prefetch ... test=develop	6 years ago
Qiao Longfei	d98c59fd2c	support none sliced variable	6 years ago
minqiyang	be04d99fe4	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into revert_vlog ... test=develop	6 years ago
Qiao Longfei	af2f5fc824	fix some bugs	6 years ago
minqiyang	53433d7f2e	Revert the changes of VLOG ... test=develop	6 years ago
Qiao Longfei	ed9fa4b301	can run	6 years ago
Qiao Longfei	686d15c8e0	update grpc_variable_response	6 years ago
peizhilin	36cd18b549	Merge remote-tracking branch 'upstream/develop' into windows/build	6 years ago
Qiao Longfei	d827881502	fix pserver and prefetch rpc	6 years ago
Qiao Longfei	5856c2f332	change Var to FindVar	6 years ago
gongweibao	c1bf9664cd	Add options to disable SO_REUSEPORT of grpc. (#14269)	6 years ago
Qiao Longfei	4ad5fd8f54	add parameter prefetch	6 years ago
Qiao Longfei	9d276fe8a8	add parameter prefetch	6 years ago
Qiao Longfei	9851a53478	add prefetch part in pserver	6 years ago
peizhilin	7c8c9dc9bf	fix unit test cases	6 years ago
sneaxiy	d231e55065	merge develop ... test=develop	6 years ago
minqiyang	0c3227a523	Change the origin VLOG level to 10 times ... Fix code to support cpplint syntax check test=develop	6 years ago