96 Commits (57557f677476d75a7b251081e97606499255a0c7)

Author	SHA1	Message	Date
tangwei12	57557f6774	fix scope in nce and prefetch	6 years ago
tangwei12	bb2e7f0bbe	add scope in prefetch	6 years ago
tangwei12	527946df49	add scope in prefetch	6 years ago
Wang Guibao	41e19eb431	AsyncExecutor (#14627) ... * AsyncExecutor: C++ side * Google naming conventions * Rename MultiExecutor to AsyncExecutor * pybind with async_executor * Naming convention * remove some flags and unused code * add refactored file of async_executor and data_feed * clear async executor interface and add data feed factory * split async executor into executor_thread_worker and async_executor, refactor pybind, add datafeed and corresponding proto * Fix async_executor interfaces: 1) Remove all protobufs; 2) Stop after each epoch * refine async_executor_refactor.cc * add some files about datafeed * Revert "add some files about datafeed" This reverts commit 8ee8133ab841196925a2812b76f18d2812a6701d. * Interface rework * add MultiSlotDataFeed * Creating DataFeedDesc from .proto file, then manipulate it (add/del fields etc) from python side * update data_feed for add MultiSlotDataFeed * update datafeed and async_executor to run bow_net demo * fix bug that finish_set_filelist failed in multithread * delete finish_binding_memory_(flag), because it can not be marked under the current interface * Fix bug * update async_executor.py for support set_use_slots * update async_executor.py for support set_use_slots and set set_dense_slots * fix bug that when the number of files is less than the number of threads, it will fetch nan * remove redundant code, and make executor exit when set a illegal queue size * add batch_size check * add MultiSlotDesc * Revert "add MultiSlotDesc" This reverts commit 2e72ebfad364ed6b5dcc75f38ffb2a1fdec83d8e. * add some checkpoint in DataFeedDesc * add CheckFile function in MultiSlotDataFeed * update something error info * fix deaded lock bug * Fix fetch variable * Merge error * fix code style in async_executor * using one lock blocking queue replace two lock blocking queue because of some bugs * update code style * add utest for data_feed * Fix fetch var * update utest for data_feed for multithread * update SetFileList info * fix bug in utest of data_feed * Add comments for python * Add comments for python code * Fix pybind.cc with new pybind11 version * add note for DataFeedDesc's set_use_slots function * Add save_model * update data_feed_test for multi-type * add comment for executor_thread_worker * Remove unused code * update data_feed_test for generate test data file * removed unnecessary interfaces and add comments * c++ style check * update data_feed.cc * AsyncExecutor: C++ side Google naming conventions Rename MultiExecutor to AsyncExecutor pybind with async_executor Naming convention remove some flags and unused code add refactored file of async_executor and data_feed clear async executor interface and add data feed factory split async executor into executor_thread_worker and async_executor, refactor pybind, add datafeed and corresponding proto Fix async_executor interfaces: 1) Remove all protobufs; 2) Stop after each epoch refine async_executor_refactor.cc add some files about datafeed Revert "add some files about datafeed" This reverts commit 8ee8133ab841196925a2812b76f18d2812a6701d. add MultiSlotDataFeed Interface rework Creating DataFeedDesc from .proto file, then manipulate it (add/del fields etc) from python side update datafeed and async_executor to run bow_net demo update async_executor.py for support set_use_slots Fix bug update async_executor.py for support set_use_slots and set set_dense_slots fix bug that when the number of files is less than the number of threads, it will fetch nan remove redundant code, and make executor exit when set a illegal queue size add MultiSlotDesc Revert "add MultiSlotDesc" This reverts commit 2e72ebfad364ed6b5dcc75f38ffb2a1fdec83d8e. add some checkpoint in DataFeedDesc Fix fetch variable fix code style in async_executor Fix fetch var add utest for data_feed Add comments for python update utest for data_feed for multithread fix bug in utest of data_feed Add comments for python code Fix pybind.cc with new pybind11 version add note for DataFeedDesc's set_use_slots function update data_feed_test for multi-type Add save_model update data_feed_test for generate test data file removed unnecessary interfaces and add comments add comment for executor_thread_worker Remove unused code update data_feed.cc c++ style check * commit for code style * commit for code style * commit for code style * commit for code style * Comment away __init__ in async_executor.py * clang-format fix test=develop * use PADDLE_THROW instead of exit(-1); use unique_ptr to manage scope var in data_feed_test.cc * commit for update code style * commit for update code style * Add async_executor demo; Remove some methods test=develop * commit for update code style * commit for update code style * commit for update code style * update API.spec * AsyncExecutor test=develop * AsyncExecutor test=develop * AsyncExecutor test=develop * AsyncExecutor test=develop * Fix API.spec test=develop * Fix API.spec test=develop * Fix windows build error test=develop * FIx windows build error test=develop * FIx windows build error test=develop * FIx windows build error test=develop * Fix Windows Build test=develop * Fix Windows Build test=develop * Fix Windows Build test=develop * Fix code style test=develop * Fix code style test=develop * update datafeed * Fix code style test=develop * update data_feed_test for test Tensor test=develop * Fix code style test=develop * Fix windows build failure test=develop * Fix code style and windows build failure test=develop * Fix PYTHON3.5 build failure test=develop * AsyncExecutor API test=develop	6 years ago
Qiao Longfei	3e45a5a5ec	lookup_table gpu kernel support prefetch ... test=develop	6 years ago
Qiao Longfei	3a3cfc2d8d	prefetch support gpu ... test=develop	6 years ago
Qiao Longfei	d32de7e6e1	fix code format test=develop	6 years ago
Qiao Longfei	5a660aee7d	update log level in parameter prefetch test=develop	6 years ago
Qiao Longfei	8ebde595c9	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into refactor-prefetch ... test=develop	6 years ago
Qiao Longfei	40f68b1349	unit test ready	6 years ago
Qiao Longfei	97cbec9b74	clean code	6 years ago
Qiao Longfei	9589babe12	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into refactor-prefetch ... test=develop	6 years ago
Qiao Longfei	d98c59fd2c	support none sliced variable	6 years ago
minqiyang	be04d99fe4	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into revert_vlog ... test=develop	6 years ago
Qiao Longfei	af2f5fc824	fix some bugs	6 years ago
minqiyang	53433d7f2e	Revert the changes of VLOG ... test=develop	6 years ago
Qiao Longfei	ed9fa4b301	can run	6 years ago
Qiao Longfei	686d15c8e0	update grpc_variable_response	6 years ago
peizhilin	36cd18b549	Merge remote-tracking branch 'upstream/develop' into windows/build	6 years ago
Qiao Longfei	d827881502	fix pserver and prefetch rpc	6 years ago
Qiao Longfei	5856c2f332	change Var to FindVar	6 years ago
gongweibao	c1bf9664cd	Add options to disable SO_REUSEPORT of grpc. (#14269)	6 years ago
Qiao Longfei	4ad5fd8f54	add parameter prefetch	6 years ago
Qiao Longfei	9d276fe8a8	add parameter prefetch	6 years ago
Qiao Longfei	9851a53478	add prefetch part in pserver	6 years ago
peizhilin	7c8c9dc9bf	fix unit test cases	6 years ago
sneaxiy	d231e55065	merge develop ... test=develop	6 years ago
minqiyang	0c3227a523	Change the origin VLOG level to 10 times ... Fix code to support cpplint syntax check test=develop	6 years ago
Yu Yang	057a682ee9	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into rewrite_allocation	6 years ago
Qiao Longfei	3b8dd9ebbd	optimize code test=develop	6 years ago
Qiao Longfei	59fbfbfbf7	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into optimize-pserver-profiler-thread-pool ... test=develop	6 years ago
Qiao Longfei	9e4e9e9b6e	clean rpc server profiler	6 years ago
Wu Yi	306236c2c0	feature/DC asgd (#12722) ... * wip * add ref_by_trainer_id op * ready to test * fix ref inputs * refine rpc_op_handle * fix merge bug	6 years ago
Yu Yang	8310ce6007	Fix cluster memory ... test=develop	6 years ago
Yu Yang	71c846ef8a	Revert buggy changes ... test=develop	6 years ago
Yu Yang	dbf9f6f408	Fix distribute compile ... test=develop	6 years ago
gongweibao	58c027cc38	Add rpc profiler flags. (#13989) ... Add rpc profiler flags	6 years ago
gongweibao	a831ecc75d	Add grpc error context. (#13957) ... Add grpc error context	6 years ago
gongweibao	078223b3e3	Add rpc timeline. (#13900) ... Add rpc timeline	6 years ago
Xin Pan	642905958a	fix compile error ... test=develop	6 years ago
Xin Pan	33b68fdf25	fix compile error ... test=develop	6 years ago
Xin Pan	6746b1fdf3	add missing header ... test=develop	6 years ago
Xin Pan	5fb72d840a	add header ... test=develop	6 years ago
Wu Yi	29c63d180f	[Feature] dist op role and lr op role, to support memory optimize with dist training (#13220) ... * wip * clean up * should fix running with memopt * add ut * mark lr schedule op role * hide lr_schedule_guard * use op_role_var instead of ufind * unify dist test name * wip for py3 support * fix var deref * fix python3 mem_opt order * remove comments	6 years ago
gongweibao	239a83860b	Fix VarHandle return bug. (#13354)	7 years ago
Wu Yi	437debf40e	Fix mac ci dist (#13393)	7 years ago
Qiyang Min	f00081a419	Merge pull request #13381 from velconia/make_mac_pass_build ... fix redundant args of lambda and remove exception of destructor	7 years ago
velconia	bb9ec4b25f	Polish code	7 years ago
gongweibao	3a3f28f99b	add (#13377)	7 years ago
velconia	926f5f43a9	fix redundant args of lambda and remove exception of destructor	7 years ago