83 Commits (1202d3fc740b065590f93a6029ab2126ca9dafff)

Author	SHA1	Message	Date
Zeng Jinle	1202d3fc74	Refine model gpu memory (#16993) ... * speedup gc and inplace softmax_with_cross_entropy_grad test=develop * refine models gpu mem Merge skip vars and warning messages of mem opt remove relu mem opt test=develop * follow comments test=develop	7 years ago
dongdaxiang	05464e7c5c	add gpu training for Executor.train_from_dataset ... test=develop	7 years ago
xjqbest	5e5139283b	fix runtime error ... test=develop	7 years ago
xjqbest	271b7147cc	fix dataset bug ... test=develop	7 years ago
dongdaxiang	a53c8cd5a7	fix infer_from_dataset docs and abastract class problem ... test=develop	7 years ago
dongdaxiang	3829eac27b	fix API spec about infer_from_dataset ... test=develop	7 years ago
dongdaxiang	87027a2eef	fix API.spec problem and executor's docstring ... test=develop	7 years ago
dongdaxiang	ade9337486	fix API.spec ... test=develop	7 years ago
dongdaxiang	60b7bf6fa6	add infer_from_dataset for inference	7 years ago
dongdaxiang	8e14d8f900	add data_generator package into setup.py	7 years ago
dongdaxiang	d87ba58c14	refine document of python API, make device_worker and trainer's API private ... test=develop	7 years ago
dongdaxiang	b95b80bc76	add doc string for executor and update API.spec ... test=develop	7 years ago
dongdaxiang	6bf796df14	refine print fetch list	7 years ago
xjqbest	1ec8fab7c8	remove error line	7 years ago
xjqbest	b7940c2918	fix bug of gen_worker_desc and set_filelist, add some doc	7 years ago
dongdaxiang	68d7bf3de5	add fetch var function ... test=develop	7 years ago
dongdaxiang	9419de521f	add IO percent for multi_trainer	7 years ago
dongdaxiang	6af697adb0	add trainfileswithprofiler for downpour worker	7 years ago
dongdaxiang	b7a202aa38	add distributed optimizer factory	7 years ago
dongdaxiang	3641a78b01	add incubate for unified API	7 years ago
dongdaxiang	e657c127a8	hide opt_info in distirbuted optimizer	7 years ago
dongdaxiang	ff87698a44	refactor downpour optimization	7 years ago
dongdaxiang	b66f0074b6	fix data reading bugs in api, add VLOG(3) log for setup	7 years ago
dongdaxiang	b415ec27e8	make Dataset* as an argument	7 years ago
sneaxiy	2f54d9f995	Merge develop ... test=develop	7 years ago
Zeng Jinle	f8df9eb32e	fix api doc (#16201) ... test=develop	7 years ago
sneaxiy	ac0e0f5181	merge develop ... test=develop	7 years ago
sneaxiy	b80d76f784	merge develop	7 years ago
sneaxiy	732fa00eaf	disable gc in recurrent_op currently ... test=develop	7 years ago
sneaxiy	7c4303bc4a	Fix doc ... test=develop	7 years ago
sneaxiy	69b1ebdfa5	merge develop ... test=develop	7 years ago
Xin Pan	8b1672fe76	follow comments ... test=develop	7 years ago
Xin Pan	26e32e095a	allow compiler to use graph ... test=develop	7 years ago
sneaxiy	7160cb0f32	decoupled reader ... test=develop	7 years ago
sneaxiy	7e399b0628	rename ... test=develop	7 years ago
sneaxiy	f85245b409	test=develop	7 years ago
Xin Pan	1d31a0e10c	resolve conflicts ... test=develop	7 years ago
Xin Pan	1888337a49	tweak the executor implementation to better match origin behavior ... test=develop	7 years ago
flame	d60751fb71	add python inference api (#15248) ... add python inference api	7 years ago
Xin Pan	abdd9411b4	fix ... test=develop	7 years ago
Xin Pan	c4b09a713f	polish ... test=develop	7 years ago
Xin Pan	5f0a0286e0	add doc ... test=develop	7 years ago
Xin Pan	8ae9094e07	polish and resolve conflicts ... test=develop	7 years ago
Xin Pan	beaae61a16	polish ... test=develop	7 years ago
Xin Pan	5e928e579a	try unify Executor and ParallelExecutor ... test=develop	7 years ago
sneaxiy	3e917a934a	add scope_pool ... add module cleanup test=develop	7 years ago
Tink_Y	6d04a9cf47	fix api format and example (#14686) ... * fix api format and examples test=develop * Update executor.py test=develop * Update nn.py * Update nn.py test=develop * Update nn.py test=develop	7 years ago
Wang Guibao	41e19eb431	AsyncExecutor (#14627) ... * AsyncExecutor: C++ side * Google naming conventions * Rename MultiExecutor to AsyncExecutor * pybind with async_executor * Naming convention * remove some flags and unused code * add refactored file of async_executor and data_feed * clear async executor interface and add data feed factory * split async executor into executor_thread_worker and async_executor, refactor pybind, add datafeed and corresponding proto * Fix async_executor interfaces: 1) Remove all protobufs; 2) Stop after each epoch * refine async_executor_refactor.cc * add some files about datafeed * Revert "add some files about datafeed" This reverts commit 8ee8133ab841196925a2812b76f18d2812a6701d. * Interface rework * add MultiSlotDataFeed * Creating DataFeedDesc from .proto file, then manipulate it (add/del fields etc) from python side * update data_feed for add MultiSlotDataFeed * update datafeed and async_executor to run bow_net demo * fix bug that finish_set_filelist failed in multithread * delete finish_binding_memory_(flag), because it can not be marked under the current interface * Fix bug * update async_executor.py for support set_use_slots * update async_executor.py for support set_use_slots and set set_dense_slots * fix bug that when the number of files is less than the number of threads, it will fetch nan * remove redundant code, and make executor exit when set a illegal queue size * add batch_size check * add MultiSlotDesc * Revert "add MultiSlotDesc" This reverts commit 2e72ebfad364ed6b5dcc75f38ffb2a1fdec83d8e. * add some checkpoint in DataFeedDesc * add CheckFile function in MultiSlotDataFeed * update something error info * fix deaded lock bug * Fix fetch variable * Merge error * fix code style in async_executor * using one lock blocking queue replace two lock blocking queue because of some bugs * update code style * add utest for data_feed * Fix fetch var * update utest for data_feed for multithread * update SetFileList info * fix bug in utest of data_feed * Add comments for python * Add comments for python code * Fix pybind.cc with new pybind11 version * add note for DataFeedDesc's set_use_slots function * Add save_model * update data_feed_test for multi-type * add comment for executor_thread_worker * Remove unused code * update data_feed_test for generate test data file * removed unnecessary interfaces and add comments * c++ style check * update data_feed.cc * AsyncExecutor: C++ side Google naming conventions Rename MultiExecutor to AsyncExecutor pybind with async_executor Naming convention remove some flags and unused code add refactored file of async_executor and data_feed clear async executor interface and add data feed factory split async executor into executor_thread_worker and async_executor, refactor pybind, add datafeed and corresponding proto Fix async_executor interfaces: 1) Remove all protobufs; 2) Stop after each epoch refine async_executor_refactor.cc add some files about datafeed Revert "add some files about datafeed" This reverts commit 8ee8133ab841196925a2812b76f18d2812a6701d. add MultiSlotDataFeed Interface rework Creating DataFeedDesc from .proto file, then manipulate it (add/del fields etc) from python side update datafeed and async_executor to run bow_net demo update async_executor.py for support set_use_slots Fix bug update async_executor.py for support set_use_slots and set set_dense_slots fix bug that when the number of files is less than the number of threads, it will fetch nan remove redundant code, and make executor exit when set a illegal queue size add MultiSlotDesc Revert "add MultiSlotDesc" This reverts commit 2e72ebfad364ed6b5dcc75f38ffb2a1fdec83d8e. add some checkpoint in DataFeedDesc Fix fetch variable fix code style in async_executor Fix fetch var add utest for data_feed Add comments for python update utest for data_feed for multithread fix bug in utest of data_feed Add comments for python code Fix pybind.cc with new pybind11 version add note for DataFeedDesc's set_use_slots function update data_feed_test for multi-type Add save_model update data_feed_test for generate test data file removed unnecessary interfaces and add comments add comment for executor_thread_worker Remove unused code update data_feed.cc c++ style check * commit for code style * commit for code style * commit for code style * commit for code style * Comment away __init__ in async_executor.py * clang-format fix test=develop * use PADDLE_THROW instead of exit(-1); use unique_ptr to manage scope var in data_feed_test.cc * commit for update code style * commit for update code style * Add async_executor demo; Remove some methods test=develop * commit for update code style * commit for update code style * commit for update code style * update API.spec * AsyncExecutor test=develop * AsyncExecutor test=develop * AsyncExecutor test=develop * AsyncExecutor test=develop * Fix API.spec test=develop * Fix API.spec test=develop * Fix windows build error test=develop * FIx windows build error test=develop * FIx windows build error test=develop * FIx windows build error test=develop * Fix Windows Build test=develop * Fix Windows Build test=develop * Fix Windows Build test=develop * Fix code style test=develop * Fix code style test=develop * update datafeed * Fix code style test=develop * update data_feed_test for test Tensor test=develop * Fix code style test=develop * Fix windows build failure test=develop * Fix code style and windows build failure test=develop * Fix PYTHON3.5 build failure test=develop * AsyncExecutor API test=develop	7 years ago
minqiyang	99d3f08920	Add print_function for all python files	7 years ago
minqiyang	1800fef142	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into port_pybind11	7 years ago