Paddle

Commit Graph

Author	SHA1	Message	Date
Xin Pan	7e0801d4ed	Merge pull request #14441 from baojun-nervana/intel/ngraph_op Implementing ngraph engine	6 years ago
Wang Guibao	41e19eb431	AsyncExecutor (#14627 ) * AsyncExecutor: C++ side * Google naming conventions * Rename MultiExecutor to AsyncExecutor * pybind with async_executor * Naming convention * remove some flags and unused code * add refactored file of async_executor and data_feed * clear async executor interface and add data feed factory * split async executor into executor_thread_worker and async_executor, refactor pybind, add datafeed and corresponding proto * Fix async_executor interfaces: 1) Remove all protobufs; 2) Stop after each epoch * refine async_executor_refactor.cc * add some files about datafeed * Revert "add some files about datafeed" This reverts commit 8ee8133ab841196925a2812b76f18d2812a6701d. * Interface rework * add MultiSlotDataFeed * Creating DataFeedDesc from .proto file, then manipulate it (add/del fields etc) from python side * update data_feed for add MultiSlotDataFeed * update datafeed and async_executor to run bow_net demo * fix bug that finish_set_filelist failed in multithread * delete finish_binding_memory_(flag), because it can not be marked under the current interface * Fix bug * update async_executor.py for support set_use_slots * update async_executor.py for support set_use_slots and set set_dense_slots * fix bug that when the number of files is less than the number of threads, it will fetch nan * remove redundant code, and make executor exit when set a illegal queue size * add batch_size check * add MultiSlotDesc * Revert "add MultiSlotDesc" This reverts commit 2e72ebfad364ed6b5dcc75f38ffb2a1fdec83d8e. * add some checkpoint in DataFeedDesc * add CheckFile function in MultiSlotDataFeed * update something error info * fix deaded lock bug * Fix fetch variable * Merge error * fix code style in async_executor * using one lock blocking queue replace two lock blocking queue because of some bugs * update code style * add utest for data_feed * Fix fetch var * update utest for data_feed for multithread * update SetFileList info * fix bug in utest of data_feed * Add comments for python * Add comments for python code * Fix pybind.cc with new pybind11 version * add note for DataFeedDesc's set_use_slots function * Add save_model * update data_feed_test for multi-type * add comment for executor_thread_worker * Remove unused code * update data_feed_test for generate test data file * removed unnecessary interfaces and add comments * c++ style check * update data_feed.cc * AsyncExecutor: C++ side Google naming conventions Rename MultiExecutor to AsyncExecutor pybind with async_executor Naming convention remove some flags and unused code add refactored file of async_executor and data_feed clear async executor interface and add data feed factory split async executor into executor_thread_worker and async_executor, refactor pybind, add datafeed and corresponding proto Fix async_executor interfaces: 1) Remove all protobufs; 2) Stop after each epoch refine async_executor_refactor.cc add some files about datafeed Revert "add some files about datafeed" This reverts commit 8ee8133ab841196925a2812b76f18d2812a6701d. add MultiSlotDataFeed Interface rework Creating DataFeedDesc from .proto file, then manipulate it (add/del fields etc) from python side update datafeed and async_executor to run bow_net demo update async_executor.py for support set_use_slots Fix bug update async_executor.py for support set_use_slots and set set_dense_slots fix bug that when the number of files is less than the number of threads, it will fetch nan remove redundant code, and make executor exit when set a illegal queue size add MultiSlotDesc Revert "add MultiSlotDesc" This reverts commit 2e72ebfad364ed6b5dcc75f38ffb2a1fdec83d8e. add some checkpoint in DataFeedDesc Fix fetch variable fix code style in async_executor Fix fetch var add utest for data_feed Add comments for python update utest for data_feed for multithread fix bug in utest of data_feed Add comments for python code Fix pybind.cc with new pybind11 version add note for DataFeedDesc's set_use_slots function update data_feed_test for multi-type Add save_model update data_feed_test for generate test data file removed unnecessary interfaces and add comments add comment for executor_thread_worker Remove unused code update data_feed.cc c++ style check * commit for code style * commit for code style * commit for code style * commit for code style * Comment away __init__ in async_executor.py * clang-format fix test=develop * use PADDLE_THROW instead of exit(-1); use unique_ptr to manage scope var in data_feed_test.cc * commit for update code style * commit for update code style * Add async_executor demo; Remove some methods test=develop * commit for update code style * commit for update code style * commit for update code style * update API.spec * AsyncExecutor test=develop * AsyncExecutor test=develop * AsyncExecutor test=develop * AsyncExecutor test=develop * Fix API.spec test=develop * Fix API.spec test=develop * Fix windows build error test=develop * FIx windows build error test=develop * FIx windows build error test=develop * FIx windows build error test=develop * Fix Windows Build test=develop * Fix Windows Build test=develop * Fix Windows Build test=develop * Fix code style test=develop * Fix code style test=develop * update datafeed * Fix code style test=develop * update data_feed_test for test Tensor test=develop * Fix code style test=develop * Fix windows build failure test=develop * Fix code style and windows build failure test=develop * Fix PYTHON3.5 build failure test=develop * AsyncExecutor API test=develop	6 years ago
baojun-nervana	1d19eb2bd4	Implemented ngraph engine test=develop	6 years ago
peizhilin	30849d1f20	Merge remote-tracking branch 'upstream/develop' into windows/build	6 years ago
peizhilin	36cd18b549	Merge remote-tracking branch 'upstream/develop' into windows/build	6 years ago
superjomn	4b40c0013b	fix compile test=develop	6 years ago
Yan Chunwei	a7188d5bc7	fix executor transfer cache bug (#14518 )	6 years ago
sneaxiy	488610a65a	merge develop test=develop	6 years ago
wopeizl	d9a1f3e58e	Windows/online (#14474 ) * add recordio support * disable the openblas multi-thread on windows since no support adjust the python script * code style * code style test=develop * add create_recordio_file_reader back * fix code style test=develop * fix the gtest.cmake on windows * fix cc_test on windows * fix the win build test=develop * remove fused compile support on windows test=develop * add the jit support test=develop * add the jit support, test=develop * add the jit support, test=develop * add the jit back fix compile error on windows * rollback test=develop * test case fix * disable DSO by default on windows * exclude warpctc_op on windows * exclude the dynload_warpctc out on windows test=develop * fix the scripts error test=develop * disable avx on windows by default test=develop * re-organize the cmake file * disable mkl on windows by default * add warp_ctc back * fix the dependency * fix the dependency * fix the build issue on windows * remove unsupported flag on windows * code style * code style test=develop * fix issue * add profiler, parallel_executor back * clean up the pre-definitions on windows * fix build issue * test=develop	6 years ago
sneaxiy	3912545ffe	add dlpack support test=develop	6 years ago
peizhilin	703b26e697	add profiler, parallel_executor back	6 years ago
peizhilin	d1429ac4a5	add recordio support	6 years ago
peizhilin	be332a13bc	Merge remote-tracking branch 'upstream/develop' into windows/build	6 years ago
baojun-nervana	ea3538d8dd	Added fused operator test=develop	6 years ago
peizhilin	a37918c31f	fix python package issue	6 years ago
Tao Luo	d770b9bda3	Merge pull request #13663 from luotao1/resnet50_ut add resnet50 inference unit-test	6 years ago
dzhwinter	32c260cd1f	"fix operators cmake" (#13581 ) * "fix operators cmake" * "rerun ci" test=develop	6 years ago
Xin Pan	ddd60581b7	clean up channel test=develop	6 years ago
Tao Luo	21ee30595b	clean some CMakeLists test=develop	6 years ago
Yan Chunwei	c8744d118d	fea/infer executor and concurrency performance issue bug fix (#13451 ) - add naive executor - fix concurrency performance issue	6 years ago
Xin Pan	36c2a9af27	pass builder allow cutomize pass in python.	6 years ago
chengduo	d402234ba8	Feature/op_fuse_pass (#12440 ) * Add Preface * Add demo code * Save file * Refine code * seems can work * use elementwise strategy * Use ElementwiseComputeEx * Add comments * extract functions from operator * Refine code * Follow comment * code refine * add op_fuse pass * add backward * code refine * use TopologySortOperations * follow comments * refine IsFusible * code enhance * fix op_fusion_pass * refine code * refine fuse_elemwise_act_op * adjust the input and output * refine logic * add intermediate_edge * disable inplace * follow comments * refine logic * follow comments * Remove the removable IntermediateOut * change strategy * code refine * enable fuse backward * code refine * code refine * rename unit test * follow comments	7 years ago
Xin Pan	4313d870a2	refine	7 years ago
Xin Pan	56a977d436	add test	7 years ago
Xin Pan	926e1077ca	version	7 years ago
dzhwinter	4fa3cee549	Windows/hidden file (#13139 ) * framework cmake * Update CMakeLists.txt	7 years ago
Xin Pan	1a67061fee	graph to program pass fix a few other things	7 years ago
dzhwinter	c790d57cd4	data_type (#12933 ) * data_type * "remove tabs"	7 years ago
dzhwinter	00463fdfe3	cudnn windows support (#12757 ) * cudnn widndows * "add comment" * "windows support" * "fix cmake error"	7 years ago
Yu Yang	c6af7201e9	Merge pull request #12692 from reyoung/feature/fast_executor Feature/fast executor	7 years ago
Qiao Longfei	03d4c7efd3	add rw lock test (#12752 ) * add rw lock test * optimize read_write and wirte_read test	7 years ago
yuyang18	05cadf1b24	Add FastExecutor	7 years ago
Xin Pan	626abfc33a	code clean up and renaming Reduce one level of inheritence.	7 years ago
dzhwinter	0c8fde7dce	"cherry picked cpp tests" (#12182 ) * "cherry picked cpp tests" * "cherry picked" * "cherry picked tests" * "merge develop branch"	7 years ago
Xin Pan	4b8ae523c4	Merge pull request #12367 from panyx0718/ir_pass Ir pass	7 years ago
minqiyang	e96fef2cf7	Fix inference api impl deps	7 years ago
Xin Pan	aa1085ddc5	all passes add doc	7 years ago
Xin Pan	5b183557f3	graph viz pass	7 years ago
qiaolongfei	65e5aebd43	fix mixed_vector_test	7 years ago
qiaolongfei	5022b14de8	fix mixed tensor compile and add cpu unit test	7 years ago
Xin Pan	af79b19207	add a simple program to graph	7 years ago
Xin Pan	08acc03522	start	7 years ago
yuyang18	2bbe5f77e7	Add GetEndPoints of Reader. We can get endpoints of a reader chain.	7 years ago
dzhwinter	4ed0b62476	Move fluid::framework::InitDevices into fluid::platform (#11757 ) * move to platform * "move init from framework to platform" * "remove used init" * "fix ci" * "fix ci" * "fix generic" * "fix ci" * "fix ci" * "fix ci" * "disable fragile test"	7 years ago
qiaolongfei	82416f1844	fix concurrency_test build error on mac	7 years ago
qiaolongfei	9ebbfa6bbc	fix build on mac	7 years ago
Wu Yi	34865f2de3	Trainer send term signal (#11220 ) * wip * use executor.complete to end trainer * fix build * fix build with distribute off * fix typo * fix cmake typo * fix build	7 years ago
chengduoZH	8291b916d6	replace graph_builder_factory with ssa_graph_builder_factory	7 years ago
yuyang18	d9af153232	SSA Graph Builder Factory * Use Builder Chain to decorate new builders. It is easy to extend builders. * Make graphviz path as a build strategy, not a FLAGS.	7 years ago
yuyang18	86a61c177f	Add ScopeBufferedSSAGraphExecutor	7 years ago
yuyang18	715c933d88	Change deps	7 years ago
yuyang18	64305b3ffc	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into feature/polish_visit_data_type	7 years ago
yuyang18	711d86bb56	Polish data_type.h	7 years ago
reyoung	a0c413833d	Polish Dctor	7 years ago
Abhinav Arora	1b5c1bcb57	Disabling Channel Test to fix CI	7 years ago
Yang Yang(Tony)	a64edbf14e	delete backward.cc related code on the python side (#9854 )	7 years ago
Yang Yang(Tony)	b26f505002	remove net op and cond_op (#9663 ) * remove net op and cond_op * fix cpplint * fix dependency * delete backward_test; fix compile * disable batch_norm backward * rm test_net.py * make batchnorm test independent of backward.cc * make test_layer_norm_op independent of backward.cc * make test_layer_norm_op independent of backward.cc * delete unused code * clean up	7 years ago
Yi Wang	eebb205324	Update CMakeLists	7 years ago
Lei Wang	09b4a1a361	Build: generate all the build related files into one directory. (#9512 )	7 years ago
Abhinav Arora	ffcc760478	Fix deadlock in channel_test (#9544 )	7 years ago
Yang Yu	af230d9bef	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into cpp_parallel_executor	7 years ago
Abhinav Arora	f5da16e51b	Disabling channel test to debug issue (#9491 )	7 years ago
Yu Yang	e3144393e3	Extract Executors to indie modules	7 years ago
Yu Yang	b123e43bf9	extract multi devices graph builder	7 years ago
Yu Yang	dd73d18bb7	Extract SSAGraph	7 years ago
Yu Yang	3181501013	Rerange code	7 years ago
Yu Yang	f28ae6e4b1	Reorganize Code	7 years ago
Yu Yang	15f5f10ed5	AddInput/AddOutput for OpHandle	7 years ago
Yu Yang	5368e50d84	Reorganize code	7 years ago
Yu Yang	fe7ed285d1	Extract NCCLCtxMap	7 years ago
Yu Yang	6ebc6bf533	ReorganizeCode	7 years ago
Yu Yang	9cb8f50302	Complete fetch op	7 years ago
Yu Yang	5e87cd7574	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into cpp_parallel_executor	7 years ago
Yu Yang	6f0dfd89a4	Single GPU ParallelExecutor complete	7 years ago
Thuan Nguyen	1e4c504e60	Implement Select OP (#9088 ) * Fix old documentation for channel_recv * Initial design of CSP select * Redesign channel implementation for Select Op * Remove unecessary header * Initial checkin of select op, currently will read all the conditional_op in the cases block and also pull out all channels involved in the select. * Init python select op API * Python select bug fix when checking op creates block * Add case_to_execute as (a) input to select, (b) into the passed inputs into the select op * Add in addition code for select op * Init fibonacci test from python * implement fibonnaci sequence test * update fib unit test * Improve select test cases * Shorten non-pep-8-ed lines * Add methods on channel needed by select op * Fix compile issues, finish implementation, still need to debug code * Fix issue with fibonncci test, it works now! * Change QueueMessage callback to take in an ChannelAction enum, fix select unit test * Fix case attributes * Fix issue with select control flow * Make cases - previously on each selectcase conditional_block - attributes to select * Use class constants for type of channel * Change select op to take in "cases" attribute * return boolean from select callback function to tell Channel if this RECV or SEND should be executed * Improve attributes and inputs comments on select op * Fix issues with python unit test * Assert fibonacci final output * Fix issue when channel name / channel var is null for "default" case in select op * Assert base select test output * Make QueueMessage use shared pointer and modify the order of the callback * Fixing the order in which the callback is called * Move channel utility methods to paddle/fluid/operators/concurrency/channel_util * Create channel_util and move channel util methods * Fix crash when calling select_op * Fix deadlock * Fix issue of channel destructor deadlock * Fix precommit issues * Accidentally checked in changes to beam_search_op, reverting change. * Fix dependency issue in concurrency cmake * add device_context dependency for concurrency target	7 years ago
Yang Yang	0621c327f1	init commit	7 years ago
Yu Yang	bcb80756af	Add Writer/Scanner Make vec<Tensor> can be serialized to RecordIO	7 years ago
kexinzhao	266ccaa843	Integrate float16 into data_type_transform (#8619 ) * test cpu float16 data transform * add isnan etc * small fix * fix containsNAN test error * add data_type transform GPU test * add float16 GPU example * fix error * fix GPU test error * add context wait	7 years ago
chengduo	12a3cea087	Add tuple type (#8519 ) * add the type of tuple * add lod_tensor to tuple	7 years ago
Abhinav Arora	0d878e4c09	Add Go_op, Channel_create, channel_close, channel_send and channel_receive ops (#8593 ) * Adding Python boilerplate code for Go op * Add very basic test case * Adding the python logic for go routine * Fix syntax * Changing test to notest * Rename Routine to Go * Combining GoGuard and Go in one class * Modify test * Adding fluid close channel * Fixing __init__.py for calling fluid.go() * Adding stubs for channel methods and updating test case * Removing import * * Adding imports from concurrency * Initial commit of GO_OP (for varun) * Creating local scopes and go through them * Updated go op inputs persistability enforcement * Add thread execution; compile failing though * Fix go op * Cleaned up Go op * Fix yapf format issue * Readd warp ctc dir for unit tests * Updated make_channel, channel_send, channel_recv and channel_close * Moved thread function to another method, update unit tests * remove output var * Add stubs for channel operators * Updating concurrency with signatures * Updated the signature with return status * Fixed dtype in variables * Updating stub of ChannelSend + add infershape * Updating stub of ChannelRecv + add infershape * Updated signature * Adding the channel_create operator * Merge channel send+receive ops * Update concurrency tests using all operators * Updating the create op with ChannelHolder * Fix issues with channel_create_op * Add the implementation for channel_close op * Add channel close operator, fix channel close op * Adding the channel_send op * Comment channels C++ and Python code * Concurrency python api comment fix * Update unit test to add Status variable * Adding channel receive operator * Update concurrency test to demonstrate a complete CSP flow * Fix clang-format issues * Fixed "Out" parameter name * Fixing merge conflict in framework.py * Add channel ops to framework.py no_kernel_op_set * Seperating channel_send and channel_recv operators * Documenting capacity type * Update concurrency test to create go block as child block of main program * Changing set status implementation	7 years ago
Yibing Liu	c0876cf686	update due to upstream's change	7 years ago
Luo Tao	7453312dee	fix error python path when building framework_py_proto	7 years ago
Yi Wang	90648f336d	Move file to fluid/; Edit CMakeLists.txt	7 years ago

1 2 3

133 Commits (526790e652502a3299b079203ec1b69f5633334a)