62 Commits (0b0adbf9b644f4873c6344b4fe960bd4c27f6775)

Author	SHA1	Message	Date
Chen Weihang	75bd350710	Implement StaticModelRunner to support dygraph fine-tune static graph pre-training model (#23171) ... * static model runner basic implement, test=develop * add run program op to execute loaded program, test=develop * refactor static model runner & run program op, test=develop * reset engine.cc to resolve conflict * adapt the change of dygraph double grad, test=develop * refactor impl to solve control flow error, test=develop * clear debug code, test=develop * fix ci str compatible error & checkout dygraph grad maker & add example, test=develop * hide api & add op test, test=develop * fix run program op test places error, test=develop * fix program by review comment, test=develop * delete change var desc name, test=develop * fix other program by review comment, test=develop * remove _static_graph_guard, test=develop * add selectedrows test, test=develop * remove desc parser, test=develop * fix detail program, test=develop * change socpe create & add test, test=develop	5 years ago
Huihuang Zheng	630be31952	Fix Cond Bug for Nested Control Flow (#21340) ... * Commit before merging develop test=develop * Backup after working with Huihuang logs * Commit before deleting Huihuang debug loggings * Commit before debug test=develop * Fix bug commit test=develop * Backup of fixing bugs test=develop * Clean up code test=develop * Fix a bug in sum_op test=develop	5 years ago
Dong Daxiang	691ced87c0	Refactor fetch handler (#21264) ... * fix fetch handler problem and refactor when a user define FetchHandler class, he or she should initialize a handler with variable dict. the key of a variable dict is a user defined name, the value of a variable dict is a Varaible generated from python API. For each fetching, a user should implement handler function in which fetched_result_dict will be available and the user can access the fetched value with user defined keys.	5 years ago
Yiqun Liu	16e4d02675	Refine the cache of program, context and scope in executor. (#18483) ... * Refine the cache of program, context and scope in executor. test=develop * Refine the unittest test_executor_and_use_program_cache. * Add the test the PaddingRNN with use_program_cache=True. test=develop * Remove a check. test=develop * Refine the unittest to check whether it is correct when setting use_program_cache=True. test=develop	5 years ago
hong	ff0886a92a	save load problem fix and new feature add (#20823) ... * fix persistable; * fix save load bugs; test=develop * fix bug; test=develop * add example for new io api; test=develop * addd example; test=develop	5 years ago
Jacek Czaja	a1cd27f13f	[MKL-DNN] Added mkl-dnn cache clearing when creating Executor instance (#20241) ... * - Flushing mkl-dnn cache test=develop - Disabled clearing cache for LoadModel - Added clearing of mkl-dnn cache when Executor is created test=develop - Do not clear for GPU places test=develop - compilation fix test=develop * - Moved clearing of mkl-dnn cache in destructor of executor test=develop * - Compilation fix test=develop - Reverted conditional clearing of mkl-dnn cache in Executors's destructor test=develop - compilation fix	5 years ago
tangwei12	c9139c3db3	trainer from dataset fetch targets (#19760) ... add executor.FetchHandler for train/infer from the dataset	5 years ago
Zeng Jinle	3f87464e9c	refine executor_gc_helper codes, test=develop (#19814)	5 years ago
guru4elephant	7f8bc49d00	polish_executor_and_add_ctx_cache (#17536) ... * polish_executor_and_add_ctx_cache	6 years ago
dongdaxiang	ade9337486	fix API.spec ... test=develop	6 years ago
dongdaxiang	720647e17f	rebase current develop and fix conflict ... test=develop	6 years ago
dongdaxiang	45eb6f0765	run pre-commit check files and fix code style problem ... test=develop	6 years ago
xujiaqi01	d25389fefd	add some log && fix error	6 years ago
dongdaxiang	e657c127a8	hide opt_info in distirbuted optimizer	6 years ago
dongdaxiang	b415ec27e8	make Dataset* as an argument	6 years ago
xjqbest	dd67ad08a2	modify c++ and python dataset related code & fix bug	6 years ago
dongdaxiang	e36bbcc871	fix some typo and CMakefile.txt	6 years ago
xjqbest	824b84d185	add DataSet and InMemoryDataFeed, support load data into memory and shuffle data	6 years ago
dongdaxiang	08c25995a2	add run from dataset in executor.	6 years ago
sneaxiy	a93a9eef8f	add op registry type ... refine gc code test=develop	6 years ago
sneaxiy	732fa00eaf	disable gc in recurrent_op currently ... test=develop	6 years ago
sneaxiy	387bac46b5	refine code ... test=develop	6 years ago
sneaxiy	64ad051b9a	merge develop ... test=develop	6 years ago
sneaxiy	c47c451a00	fix bug	6 years ago
Wang Guibao	41e19eb431	AsyncExecutor (#14627) ... * AsyncExecutor: C++ side * Google naming conventions * Rename MultiExecutor to AsyncExecutor * pybind with async_executor * Naming convention * remove some flags and unused code * add refactored file of async_executor and data_feed * clear async executor interface and add data feed factory * split async executor into executor_thread_worker and async_executor, refactor pybind, add datafeed and corresponding proto * Fix async_executor interfaces: 1) Remove all protobufs; 2) Stop after each epoch * refine async_executor_refactor.cc * add some files about datafeed * Revert "add some files about datafeed" This reverts commit 8ee8133ab841196925a2812b76f18d2812a6701d. * Interface rework * add MultiSlotDataFeed * Creating DataFeedDesc from .proto file, then manipulate it (add/del fields etc) from python side * update data_feed for add MultiSlotDataFeed * update datafeed and async_executor to run bow_net demo * fix bug that finish_set_filelist failed in multithread * delete finish_binding_memory_(flag), because it can not be marked under the current interface * Fix bug * update async_executor.py for support set_use_slots * update async_executor.py for support set_use_slots and set set_dense_slots * fix bug that when the number of files is less than the number of threads, it will fetch nan * remove redundant code, and make executor exit when set a illegal queue size * add batch_size check * add MultiSlotDesc * Revert "add MultiSlotDesc" This reverts commit 2e72ebfad364ed6b5dcc75f38ffb2a1fdec83d8e. * add some checkpoint in DataFeedDesc * add CheckFile function in MultiSlotDataFeed * update something error info * fix deaded lock bug * Fix fetch variable * Merge error * fix code style in async_executor * using one lock blocking queue replace two lock blocking queue because of some bugs * update code style * add utest for data_feed * Fix fetch var * update utest for data_feed for multithread * update SetFileList info * fix bug in utest of data_feed * Add comments for python * Add comments for python code * Fix pybind.cc with new pybind11 version * add note for DataFeedDesc's set_use_slots function * Add save_model * update data_feed_test for multi-type * add comment for executor_thread_worker * Remove unused code * update data_feed_test for generate test data file * removed unnecessary interfaces and add comments * c++ style check * update data_feed.cc * AsyncExecutor: C++ side Google naming conventions Rename MultiExecutor to AsyncExecutor pybind with async_executor Naming convention remove some flags and unused code add refactored file of async_executor and data_feed clear async executor interface and add data feed factory split async executor into executor_thread_worker and async_executor, refactor pybind, add datafeed and corresponding proto Fix async_executor interfaces: 1) Remove all protobufs; 2) Stop after each epoch refine async_executor_refactor.cc add some files about datafeed Revert "add some files about datafeed" This reverts commit 8ee8133ab841196925a2812b76f18d2812a6701d. add MultiSlotDataFeed Interface rework Creating DataFeedDesc from .proto file, then manipulate it (add/del fields etc) from python side update datafeed and async_executor to run bow_net demo update async_executor.py for support set_use_slots Fix bug update async_executor.py for support set_use_slots and set set_dense_slots fix bug that when the number of files is less than the number of threads, it will fetch nan remove redundant code, and make executor exit when set a illegal queue size add MultiSlotDesc Revert "add MultiSlotDesc" This reverts commit 2e72ebfad364ed6b5dcc75f38ffb2a1fdec83d8e. add some checkpoint in DataFeedDesc Fix fetch variable fix code style in async_executor Fix fetch var add utest for data_feed Add comments for python update utest for data_feed for multithread fix bug in utest of data_feed Add comments for python code Fix pybind.cc with new pybind11 version add note for DataFeedDesc's set_use_slots function update data_feed_test for multi-type Add save_model update data_feed_test for generate test data file removed unnecessary interfaces and add comments add comment for executor_thread_worker Remove unused code update data_feed.cc c++ style check * commit for code style * commit for code style * commit for code style * commit for code style * Comment away __init__ in async_executor.py * clang-format fix test=develop * use PADDLE_THROW instead of exit(-1); use unique_ptr to manage scope var in data_feed_test.cc * commit for update code style * commit for update code style * Add async_executor demo; Remove some methods test=develop * commit for update code style * commit for update code style * commit for update code style * update API.spec * AsyncExecutor test=develop * AsyncExecutor test=develop * AsyncExecutor test=develop * AsyncExecutor test=develop * Fix API.spec test=develop * Fix API.spec test=develop * Fix windows build error test=develop * FIx windows build error test=develop * FIx windows build error test=develop * FIx windows build error test=develop * Fix Windows Build test=develop * Fix Windows Build test=develop * Fix Windows Build test=develop * Fix code style test=develop * Fix code style test=develop * update datafeed * Fix code style test=develop * update data_feed_test for test Tensor test=develop * Fix code style test=develop * Fix windows build failure test=develop * Fix code style and windows build failure test=develop * Fix PYTHON3.5 build failure test=develop * AsyncExecutor API test=develop	6 years ago
Zhaolong Xing	ba8b5619a3	Revert "cherry picked windows patches."	6 years ago
dzhwinter	bf2e4cb188	cleard. staged	6 years ago
sneaxiy	fb6201e93e	test=develop	6 years ago
sneaxiy	114eb17587	fix executor bug	7 years ago
sneaxiy	612e1a3155	modification	7 years ago
sneaxiy	d0b2453ecd	merge develop	7 years ago
sneaxiy	24ea39c4c6	feature/eager_delete_tensor	7 years ago
Xin Pan	c558f059ad	fix	7 years ago
Yancey1989	be772741cf	compile with cpu	7 years ago
Yancey1989	efd5a84986	update executor interface	7 years ago
Yancey1989	7570d8e77c	add rpc complete interface	7 years ago
Yancey1989	1366832a41	add dist pass barrier	7 years ago
qiaolongfei	daa0fbd5f4	add keep_kids flag for executor	7 years ago
Wu Yi	34865f2de3	Trainer send term signal (#11220) ... * wip * use executor.complete to end trainer * fix build * fix build with distribute off * fix typo * fix cmake typo * fix build	7 years ago
Luo Tao	c6d230e03e	add FLAGS_use_mkldnn to global control use_mkldnn	7 years ago
Wu Yi	ebc7303990	listen_and_serv use local scope (#10663) ... * listen_and_serv use localscope * fix ut	7 years ago
Abhinav Arora	4c8ff72615	Fix CPPLint errors with rxecutor (#10212)	7 years ago
Liu Yiqun	449bdde58a	Correct some typos.	7 years ago
Liu Yiqun	339be6254e	Refine the order of arguments.	7 years ago
Liu Yiqun	bf485999f4	Merge branch 'develop' into core_inference_prepare	7 years ago
Liu Yiqun	fecbf7ff73	Merge branch 'develop' into core_inference_fix_run	7 years ago
Liu Yiqun	3a82578278	Merge branch 'develop' into core_inference_prepare	7 years ago
Liu Yiqun	fbd3604cad	Split Executor.Run to Executor.Prepare and Executor.RunPreparedContext for inference.	7 years ago
Liu Yiqun	2a2e22e35f	Merge branch 'develop' into core_inference_fix_run	7 years ago
typhoonzero	fc4bcdd753	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into prepare_pserver_executor	7 years ago