361 Commits (748c2d3ea2238ebac1e0604e0863f1a5a6799c32)

Author	SHA1	Message	Date
chengduo	eabb2105fa	Refactor MultiDevSSAGraphBuilder (#15090) ... * Refactor ParallelExecutor test=develop * extract Reduce and AllReduce mode from MultiDevSSAGraphBuilder test=develop * Refactor MultiDevSSAGraphBuilder test=developt * Remove enable_data_balance test=develop * code refine test=develop * remove data balance test=develop * refine ScaleLossGradOp test=develop * remove uncessary file test=develop * code refine test=develop * modify function name test=develop * follow comments test=develop * add is_distribution field test=develop * set is_distribution test=develop * fix DistSSAGraphBuilder test=develop	6 years ago
Xin Pan	5e928e579a	try unify Executor and ParallelExecutor ... test=develop	6 years ago
minqiyang	2547f9d1b8	Polish code ... test=develop	6 years ago
minqiyang	09e2e66236	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into imperative_mnist	6 years ago
gongweibao	ce70229ba6	Add max_body_size flags to brpc (#15084)	6 years ago
minqiyang	6a5f604607	Support stop_gradients var in imperative backward ... test=develop	6 years ago
minqiyang	9e3155e01d	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into imperative_mnist ... test=develop	6 years ago
minqiyang	336160e651	Complete imperative optimizer implementation ... test=develop	6 years ago
minqiyang	d4b9928c5a	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into imperative_mnist ... test=develop	6 years ago
minqiyang	5822f7f1d8	Polish code ... test=develop	6 years ago
Xin Pan	7b6bf9ddf2	make fill_constant kernel-based ... test=develop	6 years ago
Xin Pan	61491ce250	clean ... test=develop	6 years ago
Xin Pan	ce7e503cbe	refactor to avoid scope. ... test=develop	6 years ago
Xin Pan	71a4a8e981	Merge pull request #15071 from wopeizl/revert/15035 ... Revert "cherry-pick the #12759"	6 years ago
minqiyang	68e9b841ab	Add support for optimizer	6 years ago
Zeng Jinle	9c6a0203e2	Merge pull request #15073 from sneaxiy/add_scope_pool ... Add scope_pool	6 years ago
sneaxiy	3e917a934a	add scope_pool ... add module cleanup test=develop	6 years ago
peizhilin	2388d0e7d6	Revert "cherry-pick the #12759" ... test=develop This reverts commit 7f6d8acecb.	6 years ago
peizhilin	7f6d8acecb	cherry-pick the #12759 ... test=develop	6 years ago
minqiyang	3de0f612e8	Polish code ... test=develop	6 years ago
Zeng Jinle	95cbe07c40	Merge pull request #14836 from sneaxiy/feature/py_func ... Featue/py_func op	6 years ago
minqiyang	1c116462cc	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into imperative_mnist ... test=develop	6 years ago
minqiyang	29697c2e25	Add stop_gradient to VarBase to support loss function ... test=develop	6 years ago
chengduo	550e7e410b	Code Clean parallel_executor.py (#14849) ... * refine parallel_executor * remove uncessary code test=develop	6 years ago
minqiyang	3cd10a7c4f	Add Conv2D forward ... test=develop	6 years ago
minqiyang	8d88c5a87d	Shameless copy	6 years ago
Xin Pan	6324032602	MLP forward backward ... test=develop	6 years ago
colourful-tree	44ad2f4479	Merge pull request #14873 from colourful-tree/develop ... add pslib(pserver) to paddle, an industrial scale high performance parameter server library	6 years ago
dzhwinter	7cd24b1318	add ir memory optimize. (#14530) ... * follow comments. test=develop * Fix typo * fix compile error. test=develop * merge develop branch. test=develop * Remove set_equal * Polish code * Delete unused functions test=develop * polish code. test=develop * follow comment * polish code. * fix windows compile error. test=develop * fix op handle. * rerun ci. test=develop * rerun ci. test=develop * rerun macci. test=develop * polish code. test=develop * rewrite sort code. test=develop * remove unused code. test=develop * fix tests. test=develop * fix conflict. test=develop * follow comment. test=develop * merge develop branch. test=develop * fix tests. test=develop * remove ToTypeIndex. test=develop * rerun ci. test=develop	6 years ago
guru4elephant	a79a3ea2f0	Merge branch 'develop' into develop	6 years ago
wopeizl	0f085f0a5a	Merge pull request #14892 from wopeizl/windows/port3 ... fix script issue	6 years ago
Yu Yang	bacf1d2399	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into feature/tensor_type	6 years ago
gongweibao	0b1c7d838c	Add brpc serialization support. (#11430)	6 years ago
peizhilin	23dec78772	fix script issue ... test=develop	6 years ago
dongdaxiang	e52bb816e3	add copyright to __init__.py in distributed folder	6 years ago
sneaxiy	f0df62f136	add more unittest case ... test=develop	6 years ago
Yu Yang	4ecdb6f486	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into feature/tensor_type ... test=develop	6 years ago
sneaxiy	f6741df462	merge develop ... fix bug test=develop	6 years ago
heqiaozhi	f81957a753	refine cmake for pslib & pre_define	6 years ago
sneaxiy	deb0d41cea	fix cmake ... fix cmake again test=develop	6 years ago
sneaxiy	e7c5c9d2de	remove unnecesary code ... test=develop	6 years ago
sneaxiy	db2daefe50	merge develop ... test=develop	6 years ago
sneaxiy	ca84c2ca8f	merge develop ... test=develop	6 years ago
sneaxiy	e240ba2918	implement backward ... test=develop	6 years ago
Yu Yang	81520a24cf	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into feature/refine_eigen_tensor	6 years ago
Yu Yang	9bd70a1e04	Change tensor uses proto::VarType::type ... test=develop	6 years ago
Qiao Longfei	1213e2838f	Merge pull request #14820 from jacquesqiao/fix-split-selected-rows ... split selected rows op should always init output selected rows	6 years ago
sneaxiy	7923042365	merge develop ... test=develop	6 years ago
Qiao Longfei	0a7c7e97af	test zero output of split_selected_rows_op ... test=develop	6 years ago
Tao Luo	3243b45bb2	Merge pull request #14651 from luotao1/has_attr ... add Opdesc's HasProtoAttr	6 years ago
heqiaozhi	016a068775	stop server	6 years ago
sneaxiy	8760d23c7d	featue/py_func	6 years ago
Tao Luo	067ed70f2d	add HasProtoAttr function in op_desc.h, clean node.h ... test=develop	6 years ago
Xin Pan	748549b2e3	Revert "Merge pull request #14798 from PaddlePaddle/revert-14786-revert-14782-revert-14398-imperative" ... This reverts commit b1d3a1c8b4, reversing changes made to f1fb64b17f.	6 years ago
Xin Pan	c049fa7cf7	Revert "Revert "Revert "Imperative"""	6 years ago
gongweibao	f1fb64b17f	Add reduce sparse tensor feature. (#14757)	6 years ago
heqiaozhi	575ae7c6c3	refine pslib inferface & fix some bugs	6 years ago
Xin Pan	2538ef64f1	Revert "Revert "Imperative""	6 years ago
Xin Pan	6217f42ab7	Revert "Imperative"	6 years ago
Qiao Longfei	daba57f752	complete ctr_reader	6 years ago
sneaxiy	64ad051b9a	merge develop ... test=develop	6 years ago
sneaxiy	c47c451a00	fix bug	6 years ago
heqiaozhi	a77fa67bbd	async_thread_trainer & libmct & pslib.cmake	6 years ago
Xin Pan	b80fe8264a	polish ... test=develop	6 years ago
Xin Pan	e5d64fd4d1	initial imperative ... test=develop	6 years ago
Xin Pan	4d0df1fea7	add fields for autograd ... test=develop	6 years ago
Xin Pan	8138391631	add OpBase and unify with VarBase ... test=develop	6 years ago
Xin Pan	f6f0692451	clean up ... test=develop	6 years ago
Xin Pan	aeb74af54c	allow operator to run imperatively	6 years ago
Xin Pan	b1f6fda5e5	run forward	6 years ago
Xin Pan	a6d23083f0	some tracing ... test=develop	6 years ago
Xin Pan	dac92e560c	initial commit	6 years ago
Qiao Longfei	7f07dfa1a4	clean code	6 years ago
Wang Guibao	41e19eb431	AsyncExecutor (#14627) ... * AsyncExecutor: C++ side * Google naming conventions * Rename MultiExecutor to AsyncExecutor * pybind with async_executor * Naming convention * remove some flags and unused code * add refactored file of async_executor and data_feed * clear async executor interface and add data feed factory * split async executor into executor_thread_worker and async_executor, refactor pybind, add datafeed and corresponding proto * Fix async_executor interfaces: 1) Remove all protobufs; 2) Stop after each epoch * refine async_executor_refactor.cc * add some files about datafeed * Revert "add some files about datafeed" This reverts commit 8ee8133ab841196925a2812b76f18d2812a6701d. * Interface rework * add MultiSlotDataFeed * Creating DataFeedDesc from .proto file, then manipulate it (add/del fields etc) from python side * update data_feed for add MultiSlotDataFeed * update datafeed and async_executor to run bow_net demo * fix bug that finish_set_filelist failed in multithread * delete finish_binding_memory_(flag), because it can not be marked under the current interface * Fix bug * update async_executor.py for support set_use_slots * update async_executor.py for support set_use_slots and set set_dense_slots * fix bug that when the number of files is less than the number of threads, it will fetch nan * remove redundant code, and make executor exit when set a illegal queue size * add batch_size check * add MultiSlotDesc * Revert "add MultiSlotDesc" This reverts commit 2e72ebfad364ed6b5dcc75f38ffb2a1fdec83d8e. * add some checkpoint in DataFeedDesc * add CheckFile function in MultiSlotDataFeed * update something error info * fix deaded lock bug * Fix fetch variable * Merge error * fix code style in async_executor * using one lock blocking queue replace two lock blocking queue because of some bugs * update code style * add utest for data_feed * Fix fetch var * update utest for data_feed for multithread * update SetFileList info * fix bug in utest of data_feed * Add comments for python * Add comments for python code * Fix pybind.cc with new pybind11 version * add note for DataFeedDesc's set_use_slots function * Add save_model * update data_feed_test for multi-type * add comment for executor_thread_worker * Remove unused code * update data_feed_test for generate test data file * removed unnecessary interfaces and add comments * c++ style check * update data_feed.cc * AsyncExecutor: C++ side Google naming conventions Rename MultiExecutor to AsyncExecutor pybind with async_executor Naming convention remove some flags and unused code add refactored file of async_executor and data_feed clear async executor interface and add data feed factory split async executor into executor_thread_worker and async_executor, refactor pybind, add datafeed and corresponding proto Fix async_executor interfaces: 1) Remove all protobufs; 2) Stop after each epoch refine async_executor_refactor.cc add some files about datafeed Revert "add some files about datafeed" This reverts commit 8ee8133ab841196925a2812b76f18d2812a6701d. add MultiSlotDataFeed Interface rework Creating DataFeedDesc from .proto file, then manipulate it (add/del fields etc) from python side update datafeed and async_executor to run bow_net demo update async_executor.py for support set_use_slots Fix bug update async_executor.py for support set_use_slots and set set_dense_slots fix bug that when the number of files is less than the number of threads, it will fetch nan remove redundant code, and make executor exit when set a illegal queue size add MultiSlotDesc Revert "add MultiSlotDesc" This reverts commit 2e72ebfad364ed6b5dcc75f38ffb2a1fdec83d8e. add some checkpoint in DataFeedDesc Fix fetch variable fix code style in async_executor Fix fetch var add utest for data_feed Add comments for python update utest for data_feed for multithread fix bug in utest of data_feed Add comments for python code Fix pybind.cc with new pybind11 version add note for DataFeedDesc's set_use_slots function update data_feed_test for multi-type Add save_model update data_feed_test for generate test data file removed unnecessary interfaces and add comments add comment for executor_thread_worker Remove unused code update data_feed.cc c++ style check * commit for code style * commit for code style * commit for code style * commit for code style * Comment away __init__ in async_executor.py * clang-format fix test=develop * use PADDLE_THROW instead of exit(-1); use unique_ptr to manage scope var in data_feed_test.cc * commit for update code style * commit for update code style * Add async_executor demo; Remove some methods test=develop * commit for update code style * commit for update code style * commit for update code style * update API.spec * AsyncExecutor test=develop * AsyncExecutor test=develop * AsyncExecutor test=develop * AsyncExecutor test=develop * Fix API.spec test=develop * Fix API.spec test=develop * Fix windows build error test=develop * FIx windows build error test=develop * FIx windows build error test=develop * FIx windows build error test=develop * Fix Windows Build test=develop * Fix Windows Build test=develop * Fix Windows Build test=develop * Fix code style test=develop * Fix code style test=develop * update datafeed * Fix code style test=develop * update data_feed_test for test Tensor test=develop * Fix code style test=develop * Fix windows build failure test=develop * Fix code style and windows build failure test=develop * Fix PYTHON3.5 build failure test=develop * AsyncExecutor API test=develop	6 years ago
Qiao Longfei	75eba6108d	Add scope doc (#14582) ... * add doc for scope * update doc for force_init_on_cpu test=develop * follow comment test=develop * update format test=develop	6 years ago
minqiyang	a02ce58f2c	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into revert_vlog ... test=develop	6 years ago
wopeizl	db9284ecde	Merge pull request #14617 from wopeizl/windows/online ... Windows/online	6 years ago
gongweibao	867c312bc4	Fix allreduce dependency order. (#14586)	6 years ago
peizhilin	511cc9024a	fix for build issue	6 years ago
minqiyang	be04d99fe4	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into revert_vlog ... test=develop	6 years ago
minqiyang	53433d7f2e	Revert the changes of VLOG ... test=develop	6 years ago
minqiyang	d2045260a5	Change visibilities of variant_visitor of pybind11 ... test=develop	6 years ago
minqiyang	b67229187e	Change to PYBIND11_MODULE because the deprecation of PYBIND11_PLUGIN ... test=develop	6 years ago
minqiyang	81994e84e0	Change the include files because the version changes of pybind11 ... test=develop	6 years ago
sabreshao	61c5f13fcf	Fix cmake for AMDGPU platform (#13801) ... * HIP cmake. Enable whole archieve build for pybind library. Disable two warning. Rollback to C++11. Link RCCL to WA gpu kernel loading issue. Update eigen to fix build failure. Add more include directories. Fix O3 build failure. Update eigen. fix tensor_util_test segment fault issue add more macro check in hip.cmake. we may consider refine hip.cmake to inherit all add_definitions() in parrent scope, in the future. Fix rocRAND load. Update eigen to fix gru_unit_op and reduce_op. Add HIP support to testing. Update eigen to support int16 and int8 in arg min and arg max. * add rocprim as cub library used by nv implementation * Reduce build time in rocprim. * Add rocprim introduction, remove useless cmake code. * Remove useless flags and format cmake file.	6 years ago
Jiabin Yang	de2db11735	Merge pull request #14537 from reyoung/feature/fix_macos_ut ... fix(Cpu): fix cpu compile and unittest	6 years ago
wopeizl	d9a1f3e58e	Windows/online (#14474) ... * add recordio support * disable the openblas multi-thread on windows since no support adjust the python script * code style * code style test=develop * add create_recordio_file_reader back * fix code style test=develop * fix the gtest.cmake on windows * fix cc_test on windows * fix the win build test=develop * remove fused compile support on windows test=develop * add the jit support test=develop * add the jit support, test=develop * add the jit support, test=develop * add the jit back fix compile error on windows * rollback test=develop * test case fix * disable DSO by default on windows * exclude warpctc_op on windows * exclude the dynload_warpctc out on windows test=develop * fix the scripts error test=develop * disable avx on windows by default test=develop * re-organize the cmake file * disable mkl on windows by default * add warp_ctc back * fix the dependency * fix the dependency * fix the build issue on windows * remove unsupported flag on windows * code style * code style test=develop * fix issue * add profiler, parallel_executor back * clean up the pre-definitions on windows * fix build issue * test=develop	6 years ago
Yu Yang	533c5d5803	fix(Cpu): fix cpu compile and unittest ... test=develop	6 years ago
Yu Yang	a685f305f8	Merge pull request #14479 from reyoung/feature/fix_macos_ut ... fix(Mac): fix unittest of macos	6 years ago
Yu Yang	98bbfc17be	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into rewrite_allocation ... test=develop	6 years ago
Yu Yang	7486b0ddec	fix(Mac): fix unittest of macos ... test=develop	6 years ago
Wu Yi	a2d9b34417	Refine operator cmake (#14413) ... * wip simplify operator framework * wip * wip * done test=develop * clean test=develop * fix test=develop * fix deps test=develop * fix cpu build test=develop * fix tensorrt build test=develop * fix tests test=develop * fix test=develop * fix cpu build test=develop	6 years ago
Yu Yang	c8f6e70ab4	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into rewrite_allocation ... test=develop	6 years ago
dzhwinter	d3aed98d86	Merge pull request #14320 from wopeizl/windows/online ... Windows/online	6 years ago
peizhilin	1a9008c420	code style fix ... test=develop	6 years ago
Xin Pan	bae3659714	more test ... test=develop	6 years ago
Xin Pan	759ffca423	some improvements ... test=develop	6 years ago
Xin Pan	99dffb91d6	allow to repeatedly share and update BuildStrategy ... test=develop	6 years ago
Yu Yang	02631965c8	Refine	6 years ago
sneaxiy	d231e55065	merge develop ... test=develop	6 years ago