104 Commits (6e67d0fb78b9dd23ced460d6b2bc54fcc5bde438)

Author	SHA1	Message	Date
Wang Guibao	41e19eb431	AsyncExecutor (#14627) ... * AsyncExecutor: C++ side * Google naming conventions * Rename MultiExecutor to AsyncExecutor * pybind with async_executor * Naming convention * remove some flags and unused code * add refactored file of async_executor and data_feed * clear async executor interface and add data feed factory * split async executor into executor_thread_worker and async_executor, refactor pybind, add datafeed and corresponding proto * Fix async_executor interfaces: 1) Remove all protobufs; 2) Stop after each epoch * refine async_executor_refactor.cc * add some files about datafeed * Revert "add some files about datafeed" This reverts commit 8ee8133ab841196925a2812b76f18d2812a6701d. * Interface rework * add MultiSlotDataFeed * Creating DataFeedDesc from .proto file, then manipulate it (add/del fields etc) from python side * update data_feed for add MultiSlotDataFeed * update datafeed and async_executor to run bow_net demo * fix bug that finish_set_filelist failed in multithread * delete finish_binding_memory_(flag), because it can not be marked under the current interface * Fix bug * update async_executor.py for support set_use_slots * update async_executor.py for support set_use_slots and set set_dense_slots * fix bug that when the number of files is less than the number of threads, it will fetch nan * remove redundant code, and make executor exit when set a illegal queue size * add batch_size check * add MultiSlotDesc * Revert "add MultiSlotDesc" This reverts commit 2e72ebfad364ed6b5dcc75f38ffb2a1fdec83d8e. * add some checkpoint in DataFeedDesc * add CheckFile function in MultiSlotDataFeed * update something error info * fix deaded lock bug * Fix fetch variable * Merge error * fix code style in async_executor * using one lock blocking queue replace two lock blocking queue because of some bugs * update code style * add utest for data_feed * Fix fetch var * update utest for data_feed for multithread * update SetFileList info * fix bug in utest of data_feed * Add comments for python * Add comments for python code * Fix pybind.cc with new pybind11 version * add note for DataFeedDesc's set_use_slots function * Add save_model * update data_feed_test for multi-type * add comment for executor_thread_worker * Remove unused code * update data_feed_test for generate test data file * removed unnecessary interfaces and add comments * c++ style check * update data_feed.cc * AsyncExecutor: C++ side Google naming conventions Rename MultiExecutor to AsyncExecutor pybind with async_executor Naming convention remove some flags and unused code add refactored file of async_executor and data_feed clear async executor interface and add data feed factory split async executor into executor_thread_worker and async_executor, refactor pybind, add datafeed and corresponding proto Fix async_executor interfaces: 1) Remove all protobufs; 2) Stop after each epoch refine async_executor_refactor.cc add some files about datafeed Revert "add some files about datafeed" This reverts commit 8ee8133ab841196925a2812b76f18d2812a6701d. add MultiSlotDataFeed Interface rework Creating DataFeedDesc from .proto file, then manipulate it (add/del fields etc) from python side update datafeed and async_executor to run bow_net demo update async_executor.py for support set_use_slots Fix bug update async_executor.py for support set_use_slots and set set_dense_slots fix bug that when the number of files is less than the number of threads, it will fetch nan remove redundant code, and make executor exit when set a illegal queue size add MultiSlotDesc Revert "add MultiSlotDesc" This reverts commit 2e72ebfad364ed6b5dcc75f38ffb2a1fdec83d8e. add some checkpoint in DataFeedDesc Fix fetch variable fix code style in async_executor Fix fetch var add utest for data_feed Add comments for python update utest for data_feed for multithread fix bug in utest of data_feed Add comments for python code Fix pybind.cc with new pybind11 version add note for DataFeedDesc's set_use_slots function update data_feed_test for multi-type Add save_model update data_feed_test for generate test data file removed unnecessary interfaces and add comments add comment for executor_thread_worker Remove unused code update data_feed.cc c++ style check * commit for code style * commit for code style * commit for code style * commit for code style * Comment away __init__ in async_executor.py * clang-format fix test=develop * use PADDLE_THROW instead of exit(-1); use unique_ptr to manage scope var in data_feed_test.cc * commit for update code style * commit for update code style * Add async_executor demo; Remove some methods test=develop * commit for update code style * commit for update code style * commit for update code style * update API.spec * AsyncExecutor test=develop * AsyncExecutor test=develop * AsyncExecutor test=develop * AsyncExecutor test=develop * Fix API.spec test=develop * Fix API.spec test=develop * Fix windows build error test=develop * FIx windows build error test=develop * FIx windows build error test=develop * FIx windows build error test=develop * Fix Windows Build test=develop * Fix Windows Build test=develop * Fix Windows Build test=develop * Fix code style test=develop * Fix code style test=develop * update datafeed * Fix code style test=develop * update data_feed_test for test Tensor test=develop * Fix code style test=develop * Fix windows build failure test=develop * Fix code style and windows build failure test=develop * Fix PYTHON3.5 build failure test=develop * AsyncExecutor API test=develop	6 years ago
minqiyang	53433d7f2e	Revert the changes of VLOG ... test=develop	6 years ago
Yiqun Liu	bf222f197d	Use sub scope in tensor_array_to_tensor op. (#14524) ... test=develop	6 years ago
Yan Chunwei	a7188d5bc7	fix executor transfer cache bug (#14518)	6 years ago
Yu Yang	c8f6e70ab4	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into rewrite_allocation ... test=develop	6 years ago
Tao Luo	c7b3bfcdf1	Merge pull request #14376 from baojun-nervana/intel/ngraph_fusedop ... Adding fused operator for ngraph	6 years ago
Yan Chunwei	9f252e0032	Combine Inference Analysis with IR (#13914)	6 years ago
baojun-nervana	ea3538d8dd	Added fused operator ... test=develop	6 years ago
sneaxiy	d231e55065	merge develop ... test=develop	6 years ago
minqiyang	87450b9ad4	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into fix_vlog ... test=develop	6 years ago
Zhaolong Xing	ba8b5619a3	Revert "cherry picked windows patches."	6 years ago
minqiyang	fcc0452c8b	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into fix_vlog ... test=develop	6 years ago
minqiyang	0c3227a523	Change the origin VLOG level to 10 times ... Fix code to support cpplint syntax check test=develop	6 years ago
Yu Yang	057a682ee9	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into rewrite_allocation	6 years ago
dzhwinter	2835e04409	merge develop branch. test=develop	6 years ago
Wu Yi	306236c2c0	feature/DC asgd (#12722) ... * wip * add ref_by_trainer_id op * ready to test * fix ref inputs * refine rpc_op_handle * fix merge bug	6 years ago
dzhwinter	eb2f7ed21b	refine tests. test=develop	6 years ago
dzhwinter	bf2e4cb188	cleard. staged	6 years ago
dzhwinter	ebfe5a02b3	merge develop branch	6 years ago
dzhwinter	7141debe38	add cudnn back. staged.	6 years ago
dzhwinter	09409bad4d	staged. test speed=49ms in 1080.	6 years ago
dzhwinter	b154e0b492	clean demo_ci	6 years ago
dzhwinter	597d92179b	clean demo_ci	6 years ago
dzhwinter	c6dcffc61a	lb. add debug output	6 years ago
Yu Yang	461f71a90b	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into rewrite_allocation	6 years ago
Xin Pan	342e436158	Make Var::GetMutable robust ... test=develop	6 years ago
dzhwinter	962061f0a3	windows fix	6 years ago
sneaxiy	fb6201e93e	test=develop	6 years ago
sneaxiy	4c672ab1a2	Merge reyoung:rewrite_allocation	6 years ago
Xin Pan	ddd60581b7	clean up channel ... test=develop	6 years ago
Yu Yang	58ed412f68	refactor(memory): rewrite memory allocation and make it extentable ... Use OO style to rewrite memory allocation.	6 years ago
sneaxiy	114eb17587	fix executor bug	7 years ago
sneaxiy	612e1a3155	modification	7 years ago
sneaxiy	d0b2453ecd	merge develop	7 years ago
sneaxiy	24ea39c4c6	feature/eager_delete_tensor	7 years ago
qiaolongfei	b4d48531e4	optimize vlog before and after op run, move into op.run	7 years ago
Yancey1989	efd5a84986	update executor interface	7 years ago
Yancey1989	7570d8e77c	add rpc complete interface	7 years ago
Yancey1989	37410a0c75	update by comment	7 years ago
Yancey1989	c1ab215e26	Merge branch 'develop' of github.com:PaddlePaddle/Paddle into dist_pass_barrier	7 years ago
Yancey1989	1366832a41	add dist pass barrier	7 years ago
gongweibao	66c91911cf	Improve brpccmake (#11842)	7 years ago
Yancey	c413c46915	Merge pull request #11603 from Yancey1989/rename_details_folder ... move dist codes from operaotrs/detail to operators/distributed	7 years ago
Yancey1989	1ef6cdb60e	move dist codes from operaotrs/detail to operators/distributed	7 years ago
Qiao Longfei	05a92779f4	Merge pull request #11524 from jacquesqiao/add-keep_kids-for-executor ... add keep_kids flag for executor	7 years ago
Qiyang Min	a29cb4be2a	Fix decay bug (#11520) ... * Add sub_blocks of lr_decay_op to pserver_prog after distribute_transpiler * Remove unused logs and logics * 1. Add ops to new block (considering the nested block condition) 2. Follow the original hierarchy of blocks 3. Change the function's name and remove debug lines	7 years ago
qiaolongfei	2b1ecdf55a	update comment	7 years ago
qiaolongfei	daa0fbd5f4	add keep_kids flag for executor	7 years ago
tensor-tang	85c3bfc1f9	Merge remote-tracking branch 'ups/develop' into fix	7 years ago
tensor-tang	6602db5b3e	throw warning if try to use mkldnn while not compiled	7 years ago