137 Commits (05993c3ff3f8bfce449550e1d02dc0fe48dffaab)

Author	SHA1	Message	Date
Dun	a83e470405	Profiler refine and add CUDA runtime api tracer (#15301) ... * refine profiler && add runtime tracer * test=develop * test=develop * test=develop * test=develop * test=develop * test=develop * test=develop * test=develop * fix bug && test=develop * add thread id map && test=develop * test=develop * testing * bug fix * remove cuda event && refine code && test=develop * test=develop * test=develop * test=develop * fix windows temp file && test=develop * test=develop * fix windows bug && test=develop * fix start up issue && test=develop * code polish && test=develop * remove unused code && test=develop * add some cupti cbid && test=develop * add FLAGS_multiple_of_cupti_buffer_size && test=develop * fix compile error && test=develop * add keyword && test=develop * fix && test=develop * code polish && test=develop	6 years ago
sneaxiy	ba4f43fd62	fix compile error in distributed mode ... test=develop	6 years ago
乔龙飞 Qiao Longfei	5f89ce7fcd	Merge pull request #15536 from jacquesqiao/fix-prefetch-one-parameter ... Fix prefetch one parameter	6 years ago
Qiao Longfei	806658d72b	add space after colon in commnet test=develop	6 years ago
Qiao Longfei	4d13434443	fix a little problem test=develop	6 years ago
Qiao Longfei	9c3910f390	IncreaseBatchBarrier should be in the right condition test=develop	6 years ago
Qiao Longfei	5a0c6593d5	revert RequestGetHandler	6 years ago
gongweibao	d54494ba87	cleanup test=develop (#15347)	6 years ago
Qiao Longfei	84220765a7	refine code, add more log	6 years ago
Qiao Longfei	c750be6d9d	add some log	6 years ago
gongweibao	fe8f28c957	Add GetVariableNoBarrier on brpc. (#15488)	6 years ago
tangwei12	8b50ad80ff	checkpoint at distributed training (#14854) ... checkpoint for distributed training.	6 years ago
gongweibao	f4dec5cdee	Check collective server's data. (#15449)	6 years ago
gongweibao	7f8b40f68d	Fix brpc complation error. (#15451)	6 years ago
gongweibao	7ab4af2716	Fix brpc compilation. (#15417)	6 years ago
Wu Yi	7e651a38dd	fix mac cmake version 3.13 build (#15386) ... * fix mac cmake version 3.13 test=develop * fix again test=develop	6 years ago
Yiqun Liu	f413b6892b	Revert the modification of while_op in #14764. (#15372) ... * Revert the modification of while_op in #14764. test=develop * Remove the dependency of GRPC_DEPS. test=develop	6 years ago
Yiqun Liu	568cc2ffa8	Optimize while_op for test (#14764) ... * Simplify the compare op for CPU. * Use asynchronous tensor copy in reshape_op's kernel. * Optimize while_op for test, avoiding creating variables every time. test=develop * Enable the cache of kernel type and kernel function. test=develop * Enable profiling with gperftools. * Remove flags for testing, and fix the linking error. test=develop * Delete the codes of ChooseKernel. test=develop * Fix bug when preparing ExecutorPrepareContext for while_op. * Fix missing depending on grpc libraries. * Remove the redundant print. test=develop * Follow comments. * Remove the codes related to prepare the ExecutorPrepareContext for while_op. test=develop	6 years ago
乔龙飞 Qiao Longfei	e1679b8847	Merge pull request #14893 from JiabinYang/feature/add_prefech_hs ... Feature/add prefech hs	6 years ago
gongweibao	ce70229ba6	Add max_body_size flags to brpc (#15084)	6 years ago
Wu Yi	a8bc05b5ff	Refactor distributed RPC (#15075) ... * wip * wip * refactor no.1 dir structure test=develop * fix linking test=develop * fix includes test=develop * fix build test=develop * fix build test=develop	6 years ago
minqiyang	8ec3d863b0	Fix throw_on_error direct call bug ... test=develop	6 years ago
JiabinYang	1bec52f581	test=develop, fix cpu running error	6 years ago
Wang Guibao	e7675dd542	Avoid calling VLOG() when program exiting (#14937) ... * Avoid calling VLOG() when program exiting test=develop * Avoid calling VLOG() when program exiting test=develop	6 years ago
JiabinYang	bfcb5e5235	test=develop, fix gpu compile error on prefetch, and fix hs/nce ut failed on gpu	6 years ago
JiabinYang	4877f5d71f	test=develop, fix compile error under gpu mode	6 years ago
JiabinYang	8515ee3a29	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into feature/add_prefech_hs	6 years ago
gongweibao	b849157e9d	Add size enforce (#14919)	6 years ago
JiabinYang	3b7b2e1ded	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into feature/add_prefech_hs	6 years ago
JiabinYang	656040c726	merge reyoung optimization	6 years ago
gongweibao	addded48e1	test=develop (#14898)	6 years ago
Yu Yang	bacf1d2399	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into feature/tensor_type	6 years ago
gongweibao	0b1c7d838c	Add brpc serialization support. (#11430)	6 years ago
JiabinYang	50fce87905	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into feature/add_prefech_hs	6 years ago
Yu Yang	194e66f785	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into feature/tensor_type	6 years ago
JiabinYang	c2e851f7b2	test=develop, remove sparse bias and add prefetch and related tests	6 years ago
Yu Yang	c00e07cda0	Fix distribute compile ... test=develop	6 years ago
Qiao Longfei	1870262ba9	pserver should crash early whe has problem ... test=develop	6 years ago
JiabinYang	c35fdf1581	Merge branch 'add_prefetch_in_nce' of https://github.com/seiriosPlus/Paddle into feature/add_prefech_hs	6 years ago
tangwei12	33a004a779	fix numel nce and prefetch	6 years ago
tangwei12	57557f6774	fix scope in nce and prefetch	6 years ago
tangwei12	bb2e7f0bbe	add scope in prefetch	6 years ago
gongweibao	f1fb64b17f	Add reduce sparse tensor feature. (#14757)	6 years ago
tangwei12	527946df49	add scope in prefetch	6 years ago
Wang Guibao	41e19eb431	AsyncExecutor (#14627) ... * AsyncExecutor: C++ side * Google naming conventions * Rename MultiExecutor to AsyncExecutor * pybind with async_executor * Naming convention * remove some flags and unused code * add refactored file of async_executor and data_feed * clear async executor interface and add data feed factory * split async executor into executor_thread_worker and async_executor, refactor pybind, add datafeed and corresponding proto * Fix async_executor interfaces: 1) Remove all protobufs; 2) Stop after each epoch * refine async_executor_refactor.cc * add some files about datafeed * Revert "add some files about datafeed" This reverts commit 8ee8133ab841196925a2812b76f18d2812a6701d. * Interface rework * add MultiSlotDataFeed * Creating DataFeedDesc from .proto file, then manipulate it (add/del fields etc) from python side * update data_feed for add MultiSlotDataFeed * update datafeed and async_executor to run bow_net demo * fix bug that finish_set_filelist failed in multithread * delete finish_binding_memory_(flag), because it can not be marked under the current interface * Fix bug * update async_executor.py for support set_use_slots * update async_executor.py for support set_use_slots and set set_dense_slots * fix bug that when the number of files is less than the number of threads, it will fetch nan * remove redundant code, and make executor exit when set a illegal queue size * add batch_size check * add MultiSlotDesc * Revert "add MultiSlotDesc" This reverts commit 2e72ebfad364ed6b5dcc75f38ffb2a1fdec83d8e. * add some checkpoint in DataFeedDesc * add CheckFile function in MultiSlotDataFeed * update something error info * fix deaded lock bug * Fix fetch variable * Merge error * fix code style in async_executor * using one lock blocking queue replace two lock blocking queue because of some bugs * update code style * add utest for data_feed * Fix fetch var * update utest for data_feed for multithread * update SetFileList info * fix bug in utest of data_feed * Add comments for python * Add comments for python code * Fix pybind.cc with new pybind11 version * add note for DataFeedDesc's set_use_slots function * Add save_model * update data_feed_test for multi-type * add comment for executor_thread_worker * Remove unused code * update data_feed_test for generate test data file * removed unnecessary interfaces and add comments * c++ style check * update data_feed.cc * AsyncExecutor: C++ side Google naming conventions Rename MultiExecutor to AsyncExecutor pybind with async_executor Naming convention remove some flags and unused code add refactored file of async_executor and data_feed clear async executor interface and add data feed factory split async executor into executor_thread_worker and async_executor, refactor pybind, add datafeed and corresponding proto Fix async_executor interfaces: 1) Remove all protobufs; 2) Stop after each epoch refine async_executor_refactor.cc add some files about datafeed Revert "add some files about datafeed" This reverts commit 8ee8133ab841196925a2812b76f18d2812a6701d. add MultiSlotDataFeed Interface rework Creating DataFeedDesc from .proto file, then manipulate it (add/del fields etc) from python side update datafeed and async_executor to run bow_net demo update async_executor.py for support set_use_slots Fix bug update async_executor.py for support set_use_slots and set set_dense_slots fix bug that when the number of files is less than the number of threads, it will fetch nan remove redundant code, and make executor exit when set a illegal queue size add MultiSlotDesc Revert "add MultiSlotDesc" This reverts commit 2e72ebfad364ed6b5dcc75f38ffb2a1fdec83d8e. add some checkpoint in DataFeedDesc Fix fetch variable fix code style in async_executor Fix fetch var add utest for data_feed Add comments for python update utest for data_feed for multithread fix bug in utest of data_feed Add comments for python code Fix pybind.cc with new pybind11 version add note for DataFeedDesc's set_use_slots function update data_feed_test for multi-type Add save_model update data_feed_test for generate test data file removed unnecessary interfaces and add comments add comment for executor_thread_worker Remove unused code update data_feed.cc c++ style check * commit for code style * commit for code style * commit for code style * commit for code style * Comment away __init__ in async_executor.py * clang-format fix test=develop * use PADDLE_THROW instead of exit(-1); use unique_ptr to manage scope var in data_feed_test.cc * commit for update code style * commit for update code style * Add async_executor demo; Remove some methods test=develop * commit for update code style * commit for update code style * commit for update code style * update API.spec * AsyncExecutor test=develop * AsyncExecutor test=develop * AsyncExecutor test=develop * AsyncExecutor test=develop * Fix API.spec test=develop * Fix API.spec test=develop * Fix windows build error test=develop * FIx windows build error test=develop * FIx windows build error test=develop * FIx windows build error test=develop * Fix Windows Build test=develop * Fix Windows Build test=develop * Fix Windows Build test=develop * Fix code style test=develop * Fix code style test=develop * update datafeed * Fix code style test=develop * update data_feed_test for test Tensor test=develop * Fix code style test=develop * Fix windows build failure test=develop * Fix code style and windows build failure test=develop * Fix PYTHON3.5 build failure test=develop * AsyncExecutor API test=develop	6 years ago
Qiao Longfei	3e45a5a5ec	lookup_table gpu kernel support prefetch ... test=develop	6 years ago
Qiao Longfei	3a3cfc2d8d	prefetch support gpu ... test=develop	6 years ago
Qiao Longfei	d32de7e6e1	fix code format test=develop	6 years ago
Qiao Longfei	5a660aee7d	update log level in parameter prefetch test=develop	6 years ago
Qiao Longfei	8ebde595c9	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into refactor-prefetch ... test=develop	6 years ago