6900 Commits (e52bb816e36b5df53c1608f3aada655b21d11ab5)

Author	SHA1	Message	Date
dongdaxiang	e52bb816e3	add copyright to __init__.py in distributed folder	6 years ago
dongdaxiang	f6c3086329	add copy rigth checker to ps_pb2.py	6 years ago
dongdaxiang	0693053188	add liscence	6 years ago
heqiaozhi	7bd16e3afa	fix some bug & add log	7 years ago
heqiaozhi	5d3ecbfdf5	fix hdfs bug	7 years ago
heqiaozhi	2c1e986f22	barrier_all to barrier_worker	7 years ago
heqiaozhi	009c7cf6cc	add finialize	7 years ago
heqiaozhi	faffc25c19	fix hadoop home bug & refine setup.py	7 years ago
heqiaozhi	1500c8e621	is instance is None	7 years ago
heqiaozhi	10ed9e0a6e	download & run & instance	7 years ago
heqiaozhi	57ac412b98	download data	7 years ago
heqiaozhi	729684007d	stop server out of run from file	7 years ago
heqiaozhi	60d71a9e29	skip op py file	7 years ago
heqiaozhi	016a068775	stop server	7 years ago
heqiaozhi	86e1044ab9	refine interface & add ps_instance	7 years ago
heqiaozhi	6bc0efb489	refine interface	7 years ago
heqiaozhi	575ae7c6c3	refine pslib inferface & fix some bugs	7 years ago
dongdaxiang	06213b7981	add hadoop helper function for distributed training	7 years ago
dongdaxiang	49130f9b8f	refine downpour sgd API and adapt to pslib proto desc	7 years ago
guru4elephant	0a3d8a2945	Merge pull request #1 from guru4elephant/for_pslib ... For pslib	7 years ago
dongdaxiang	ee4c51a372	refine downpour sgd API with pslib	7 years ago
heqiaozhi	a77fa67bbd	async_thread_trainer & libmct & pslib.cmake	7 years ago
dongdaxiang	c583fd34ac	add downpour sgd wrapper for pslib	7 years ago
dongdaxiang	0e4709dadd	add mpi4py helper	7 years ago
Wang Guibao	41e19eb431	AsyncExecutor (#14627) ... * AsyncExecutor: C++ side * Google naming conventions * Rename MultiExecutor to AsyncExecutor * pybind with async_executor * Naming convention * remove some flags and unused code * add refactored file of async_executor and data_feed * clear async executor interface and add data feed factory * split async executor into executor_thread_worker and async_executor, refactor pybind, add datafeed and corresponding proto * Fix async_executor interfaces: 1) Remove all protobufs; 2) Stop after each epoch * refine async_executor_refactor.cc * add some files about datafeed * Revert "add some files about datafeed" This reverts commit 8ee8133ab841196925a2812b76f18d2812a6701d. * Interface rework * add MultiSlotDataFeed * Creating DataFeedDesc from .proto file, then manipulate it (add/del fields etc) from python side * update data_feed for add MultiSlotDataFeed * update datafeed and async_executor to run bow_net demo * fix bug that finish_set_filelist failed in multithread * delete finish_binding_memory_(flag), because it can not be marked under the current interface * Fix bug * update async_executor.py for support set_use_slots * update async_executor.py for support set_use_slots and set set_dense_slots * fix bug that when the number of files is less than the number of threads, it will fetch nan * remove redundant code, and make executor exit when set a illegal queue size * add batch_size check * add MultiSlotDesc * Revert "add MultiSlotDesc" This reverts commit 2e72ebfad364ed6b5dcc75f38ffb2a1fdec83d8e. * add some checkpoint in DataFeedDesc * add CheckFile function in MultiSlotDataFeed * update something error info * fix deaded lock bug * Fix fetch variable * Merge error * fix code style in async_executor * using one lock blocking queue replace two lock blocking queue because of some bugs * update code style * add utest for data_feed * Fix fetch var * update utest for data_feed for multithread * update SetFileList info * fix bug in utest of data_feed * Add comments for python * Add comments for python code * Fix pybind.cc with new pybind11 version * add note for DataFeedDesc's set_use_slots function * Add save_model * update data_feed_test for multi-type * add comment for executor_thread_worker * Remove unused code * update data_feed_test for generate test data file * removed unnecessary interfaces and add comments * c++ style check * update data_feed.cc * AsyncExecutor: C++ side Google naming conventions Rename MultiExecutor to AsyncExecutor pybind with async_executor Naming convention remove some flags and unused code add refactored file of async_executor and data_feed clear async executor interface and add data feed factory split async executor into executor_thread_worker and async_executor, refactor pybind, add datafeed and corresponding proto Fix async_executor interfaces: 1) Remove all protobufs; 2) Stop after each epoch refine async_executor_refactor.cc add some files about datafeed Revert "add some files about datafeed" This reverts commit 8ee8133ab841196925a2812b76f18d2812a6701d. add MultiSlotDataFeed Interface rework Creating DataFeedDesc from .proto file, then manipulate it (add/del fields etc) from python side update datafeed and async_executor to run bow_net demo update async_executor.py for support set_use_slots Fix bug update async_executor.py for support set_use_slots and set set_dense_slots fix bug that when the number of files is less than the number of threads, it will fetch nan remove redundant code, and make executor exit when set a illegal queue size add MultiSlotDesc Revert "add MultiSlotDesc" This reverts commit 2e72ebfad364ed6b5dcc75f38ffb2a1fdec83d8e. add some checkpoint in DataFeedDesc Fix fetch variable fix code style in async_executor Fix fetch var add utest for data_feed Add comments for python update utest for data_feed for multithread fix bug in utest of data_feed Add comments for python code Fix pybind.cc with new pybind11 version add note for DataFeedDesc's set_use_slots function update data_feed_test for multi-type Add save_model update data_feed_test for generate test data file removed unnecessary interfaces and add comments add comment for executor_thread_worker Remove unused code update data_feed.cc c++ style check * commit for code style * commit for code style * commit for code style * commit for code style * Comment away __init__ in async_executor.py * clang-format fix test=develop * use PADDLE_THROW instead of exit(-1); use unique_ptr to manage scope var in data_feed_test.cc * commit for update code style * commit for update code style * Add async_executor demo; Remove some methods test=develop * commit for update code style * commit for update code style * commit for update code style * update API.spec * AsyncExecutor test=develop * AsyncExecutor test=develop * AsyncExecutor test=develop * AsyncExecutor test=develop * Fix API.spec test=develop * Fix API.spec test=develop * Fix windows build error test=develop * FIx windows build error test=develop * FIx windows build error test=develop * FIx windows build error test=develop * Fix Windows Build test=develop * Fix Windows Build test=develop * Fix Windows Build test=develop * Fix code style test=develop * Fix code style test=develop * update datafeed * Fix code style test=develop * update data_feed_test for test Tensor test=develop * Fix code style test=develop * Fix windows build failure test=develop * Fix code style and windows build failure test=develop * Fix PYTHON3.5 build failure test=develop * AsyncExecutor API test=develop	7 years ago
whs	78738d6c86	Fix comments of ctc_greedy_decoder. (#14679) ... test=develop	7 years ago
whs	1b9753d109	Make pad2d support for variable paddings. (#14667) ... * Make pad2d support for variable paddings. test=develop * Rename get_paddings and add inline modifier. test=develop * Fix comments.	7 years ago
gongweibao	5d334ff0f1	Add examples to some functions. (#14645)	7 years ago
Qiao Longfei	44debca844	Merge pull request #14589 from jacquesqiao/refactor-prefetch ... Refactor prefetch	7 years ago
Qiao Longfei	839193fd1f	fix unit test test=develop	7 years ago
Qiao Longfei	9450048acb	add PADDLE_ENABLE_REMOTE_PREFETCH to enable remote prefetch ... test=develop	7 years ago
Tao Luo	20120d9c97	Merge pull request #14608 from jczaja/prv-conv2d-transpose-mkldnn ... [MKL-DNN]conv2d transpose	7 years ago
qingqing01	731d45a39a	Enable BatchNorm to use global mean and variane during training (#14630) ... * Enable BatchNorm to use global mean and variane during training * Update doc and follow comments.	7 years ago
Qiyang Min	400cf19f14	Merge pull request #14657 from velconia/disable_ut_in_mac_py35 ... Remove test_recognize_digits_mlp from Mac	7 years ago
Qiyang Min	25c2cdaf7e	Merge pull request #14647 from velconia/revert_vlog ... Fix data download of wmt16	7 years ago
Qiao Longfei	75eba6108d	Add scope doc (#14582) ... * add doc for scope * update doc for force_init_on_cpu test=develop * follow comment test=develop * update format test=develop	7 years ago
minqiyang	6720d343ce	Remove test_recognize_digits_mlp from Mac ... test=develop	7 years ago
Qiao Longfei	3a3cfc2d8d	prefetch support gpu ... test=develop	7 years ago
chengduo	6776e92846	refine tensor_array_write_read (#14643) ... test=develop	7 years ago
minqiyang	a24db02f4a	Fix data download of wmt14 ... test=develop	7 years ago
Qiao Longfei	8ebde595c9	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into refactor-prefetch ... test=develop	7 years ago
Yu Yang	4ffc376497	Merge pull request #14635 from reyoung/feature/loose_atol ... Loose atol in test_pe_test_wwhile_train	7 years ago
Qiao Longfei	c8b0241da2	fix code style test=develop	7 years ago
Qiao Longfei	145c535750	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into refactor-prefetch ... test=develop	7 years ago
Qiao Longfei	b2c9efef2b	add more unit test for lookup_remote_table ... test=develop	7 years ago
Jiabin Yang	12e1719f96	Merge pull request #14352 from JiabinYang/enhance_hierachical_sigmod_op ... Enhance hierarchical sigmoid op	7 years ago
Yu Yang	d40881cb82	Loose atol in test_pe_test_wwhile_train ... test=develop	7 years ago
Qiao Longfei	40f68b1349	unit test ready	7 years ago
Tao Luo	fb268221dc	Merge pull request #14631 from guomingz/develop ... Fix the invalid list operation on save_inference_model function.	7 years ago
Qiao Longfei	35b79ab865	Merge pull request #13983 from jacquesqiao/add-ctr-reader ... Add ctr reader	7 years ago