Commit Graph

265 Commits (289edf3962f039394452bfccafcd70ce3c3dde0f)

Author SHA1 Message Date
sneaxiy d4d946db5a update blocking queue
7 years ago
sneaxiy 67556e4aa4 update blocking queue
7 years ago
sneaxiy 502faf62a9 complete_py_reader_cpp
7 years ago
sneaxiy 7b2339d7c5 delete create_py_array_reader_op.cc
7 years ago
sneaxiy 2dcf0e4e66 delete py_array_feed_queue.h
7 years ago
sneaxiy 9b63fef32d delete some redundant comments
7 years ago
sneaxiy 697ba4b13d Add Python array reader op
7 years ago
fengjiayi bc9d19c7d6 fix a bug
7 years ago
fengjiayi 32478fe0ea Make buffers of DoubleBufferReader and open_files bigger
7 years ago
fengjiayi e71948f167 Refine random crop
7 years ago
yuyang18 54002c3bab Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into feature/polish_doc
7 years ago
yuyang18 ff55d4c593 Polish documents
7 years ago
fengjiayi 499dbe0536 fix a multi-thread bug in readers
7 years ago
fengjiayi 3526ac1136 refine code
7 years ago
fengjiayi 744cc412b7 fix a bug
7 years ago
fengjiayi ee4e567dea Creating readers before training begining
7 years ago
fengjiayi 32c0e82ca0 fix two bugs
7 years ago
fengjiayi cd8700f172
Merge pull request #10872 from JiayiFeng/dev_CustomReader
7 years ago
fengjiayi 8147063539 follow comments
7 years ago
fengjiayi 0457f06434 add comments
7 years ago
fengjiayi e4e9d3624f fix a potential bug
7 years ago
fengjiayi 239546a6c1 add unit test and fix a bug
7 years ago
fengjiayi 2e42b31f45 refine code
7 years ago
fengjiayi 4b395b0809 fix errors
7 years ago
fengjiayi c2436f2ca5 expose random_data_generator
7 years ago
fengjiayi b48eba1902 complete python API and unit test
7 years ago
fengjiayi 983c9a2a30 Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into dev_CustomReader
7 years ago
fengjiayi e15d616e29 Complete the C++ core of 'CustomReader'
7 years ago
fengjiayi e61a38daa3 init CustomReader
7 years ago
Yu Yang 0e78cb69fb Clean OpProtoAndCheckerMaker
7 years ago
fengjiayi 71fa3ca9c4
Merge pull request #10232 from JiayiFeng/fix_unittests
7 years ago
fengjiayi 30f9dc92e5 fix errors
7 years ago
fengjiayi 330fa95cbd Follow comments
7 years ago
Abhinav Arora 83b1a8f6bf
Pending more CPPLint errors in fluid/operators/math (#10243)
7 years ago
Abhinav Arora f457d5da06
Fix more CPPLint errors (#10218)
7 years ago
fengjiayi 8bd34664f1 fix unit test error
7 years ago
fengjiayi 17c51d69d1 fix unit test error
7 years ago
fengjiayi 304b6b7138 Follow comments
7 years ago
fengjiayi 4cb63d8451 Remove unnecessary header files
7 years ago
fengjiayi e057ba6877 Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into blocking_queue_for_reader
7 years ago
fengjiayi e2ca42408b Replace Channel in DoubleBufferReader with BlockingQueue
7 years ago
fengjiayi a786611314 Replace Channel in MultiFileReader with BlockingQueue
7 years ago
fengjiayi 1a25f3cd07 Add reader blocking queue
7 years ago
Yu Yang 54ada9449e Add demo for recordio train/test and parallel executor
7 years ago
fengjiayi 9f11da5931 Add synchronous TensorCopy and use it in double buffer
7 years ago
fengjiayi 3fa0ef3d71 Refine double_buffer code
7 years ago
fengjiayi 7a78294666 Remove Readers' HasNext()
7 years ago
fengjiayi a84b81502c Remove Readers' HasNext()
7 years ago
JiayiFeng ee178d5aeb fix bugs
7 years ago
fengjiayi 5416bac5d8 Make shared decorated readers' creater be only in main_program
7 years ago
fengjiayi 6be51f10ec Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into modify_readers_to_fit_parallel_executor
7 years ago
fengjiayi 38ba7e5af4 Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into update_reader
7 years ago
fengjiayi 49ab52d64d Modify MultipleReader
7 years ago
JiayiFeng 03ff0e58fe fix compile errors
7 years ago
fengjiayi 8fed780f14 Complete threaded reader
7 years ago
fengjiayi 442c150333 a draft of ThreadedReader
7 years ago
fengjiayi af24290123 Add 'buffer_size' api for open_files op
7 years ago
fengjiayi 8441347808 fix lint
7 years ago
fengjiayi a122dcccd5 fix lint
7 years ago
fengjiayi 3cd9e450ac fix lint
7 years ago
fengjiayi f2c0b88649
Merge pull request #9550 from JiayiFeng/make_MultipleReader_thread-safe
7 years ago
fengjiayi 44d5f42a7e update reader
7 years ago
Yi Wang 736950603e Resolve conflicts
7 years ago
fengjiayi b94f24d44f Move StartPrefetcher and EndPrefetcher to private
7 years ago
fengjiayi 2945a98eb3 Make MultipleReader thread-safe
7 years ago
JiayiFeng 597c845c99 fix typo
7 years ago
JiayiFeng c0257f0a5b Add comments
7 years ago
JiayiFeng 5aa440fd7a Add move constructor for Item
7 years ago
JiayiFeng a469666e42 fix compile errors
7 years ago
fengjiayi 55e4b89f14 remove local_buffer_
7 years ago
fengjiayi 7bb18433fd refine code
7 years ago
Yu Yang 53fa7cb9cc Add local cache of double buffer reader
7 years ago
Yang Yu af230d9bef Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into cpp_parallel_executor
7 years ago
fengjiayi 1a4b0d63e4
Merge pull request #9352 from JiayiFeng/doc_update_reader_doc
7 years ago
Yang Yu b0775588c0 Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into cpp_parallel_executor
7 years ago
Abhinav Arora 65534c4762
Fluid channels should match the semantics of Go Channels (#9265)
7 years ago
Yu Yang 02aaecca35 Fix CPU compile
7 years ago
Yu Yang 50e7e25db3 Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into cpp_parallel_executor
7 years ago
fengjiayi dd532e2086 refine MultiPassReader's doc string
7 years ago
fengjiayi 809530f418 Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into dev_MultiEpochReader
7 years ago
fengjiayi 91b6d60003 Merge branch 'fix_bug_in_recordio' into dev_MultiEpochReader
7 years ago
fengjiayi 2532b922dc Add more unittests and fix bugs
7 years ago
fengjiayi f863866471 Add an unitest
7 years ago
fengjiayi 02b7d8bea5 Merge branch 'fix_bug_in_recordio' into dev_MultipleReader
7 years ago
fengjiayi a2981f5c50 fix a bug
7 years ago
fengjiayi 6f7e812bb3 fix bugs
7 years ago
fengjiayi d9868b0839 Add multi_pass_reader
7 years ago
fengjiayi 07d38a9b9a refine patch
7 years ago
fengjiayi a571ef382e fix bugs
7 years ago
fengjiayi 3d677b1eca fix compile errors and make OpenFilesOpMaker derived from FileReaderMakerBase
7 years ago
fengjiayi 550622529c Add MultipleReader and open_files_op
7 years ago
Yu Yang 5e87cd7574 Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into cpp_parallel_executor
7 years ago
Yu Yang 8b397d1602 Make recordio file reader thread-safe by default
7 years ago
Yu Yang d84ddcf123 Stash
7 years ago
Yu Yang 164f2382af Polish code
7 years ago
Yu Yang e13aec601a
Merge pull request #8830 from reyoung/feature/recordio_file_reader
7 years ago
Yu Yang f9974a4a12 Make double_buffer reader async
7 years ago
Yu Yang a8c076e577 Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into feature/shuffle_reader
7 years ago
Yu Yang 225efa671f Remove dims in base class
7 years ago
Yu Yang 2ea4a5d96c Polish double buffer reader
7 years ago
Yu Yang 46ae4075ee Polish ShuffleReader and test
7 years ago
Yu Yang 7eedced82a Polish RecordIO
7 years ago
Yu Yang cfca8a3a26 Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into feature/recordio_file_reader
7 years ago
Yu Yang fea43077f6 Refine
7 years ago
fengjiayi 614c33fb3a fix a potential bug in the c++ reader
7 years ago
fengjiayi 35e1e0d521 uses channel to replace the traditional buffer
7 years ago
fengjiayi b3a11fdf3a Merge branch 'rm_reader_HasNext' into dev_double_buffer_for_cpp_reader
7 years ago
fengjiayi 6e5736e270 fix a compile error
7 years ago
fengjiayi 4e517881f7 remove HasNext
7 years ago
Yu Yang 72be7a6151 Complete RecordIO reader op
7 years ago
fengjiayi b1f647fd6d fix errors
7 years ago
fengjiayi e8d21b6349 fix an error
7 years ago
fengjiayi 4fb7b96756 Add basic double buffer reader
7 years ago
Yu Yang 4690b9c987 FIX CI
7 years ago
Yu Yang 4d8345e3ac Extract create_reader_op to three files
7 years ago