Commit Graph

219 Commits (d9270e34d1505294fcaa268f095f469233e9eb5d)

Author SHA1 Message Date
Qiao Longfei d37b9797ec update test
7 years ago
Qiao Longfei 4051fb36b5 add monitor thread
7 years ago
Qiao Longfei e67783375d code clean
7 years ago
Qiao Longfei 5c65eff6ef update test for ctr data
7 years ago
Qiao Longfei 044d2e20bf update test method
7 years ago
Qiao Longfei 92cbaa41eb add GetTimeInSec
7 years ago
Qiao Longfei dd2dfeb624 add debug information
7 years ago
Qiao Longfei 803e2ed9f4 add ctr_reader_test and fix bug
7 years ago
Qiao Longfei c8bd521045 add reader thread status
7 years ago
Qiao Longfei 71cbc8bd24 optimize code
7 years ago
Qiao Longfei 694e8945a2 add a base class for reader
7 years ago
Qiao Longfei d981333e94 add a base class for reader
7 years ago
Qiao Longfei a06173eedc clean code
7 years ago
Qiao Longfei 71c2ad412f complete read thread
7 years ago
Qiao Longfei 0f3ece775d use gzstream
7 years ago
Qiao Longfei a1e0f5abb7 add gzstream.cmake
7 years ago
Qiao Longfei 20f181cdc1 init ctr_reader
7 years ago
Tao Luo e47f4186ae fix some compiler warning
7 years ago
Qiao Longfei d26e4507da init ctr data
7 years ago
Qiao Longfei 60030e8678 change the use of FLAGS_reader_queue_speed_test_mode
7 years ago
Qiao Longfei c61e16b181 add reader_queue_speed_test_mode_flag test
7 years ago
Qiao Longfei 8686f7c68e add reader_queue_speed_test_mode flag for speed test
7 years ago
Yu Yang 21387e3c2a Tiny refines for lod_tensor_blocking_queue and reshape_op
7 years ago
fengjiayi 060f421797 Some enhancement on readers
7 years ago
yuyang18 8c70183ba6
Polish function names
7 years ago
yuyang18 b789a3a484
Change code
7 years ago
yuyang18 401e92f6e3
Change attr comment
7 years ago
yuyang18 72b78154b2
Polish reader speed
7 years ago
yuyang18 e576345f5b
Try to speed up buffered reader
7 years ago
yuyang18 61b3a5977f
Refine Python Reader
7 years ago
yuyang18 b048ddf0bd
Merge error
7 years ago
yuyang18 d36e13efd8
Merge branch 'feature/add_pyreader_demo' into feature/combine_open_files_and_double_buffer
7 years ago
yuyang18 1478a5fc0b
Make open_files use buffer
7 years ago
yuyang18 dc34effd35
Extract buffered reader
7 years ago
yuyang18 392318045f
Merge branch 'feature/dctor_all_readers' into feature/combine_open_files_and_double_buffer
7 years ago
yuyang18 fecbe52200
Rewrite open_files
7 years ago
Yu Yang ba997b8ccd
Merge pull request #12097 from reyoung/feature/hide_api_cont
7 years ago
yuyang18 c680bc1d7f
Rewrite DoubleBuffer
7 years ago
yuyang18 c9cf2bdb9c
Dctor cache
7 years ago
yuyang18 ee7d8b4d66
Refine Shutdown Impl
7 years ago
sneaxiy 31c7f6b968
Merge branch 'develop' into complete_py_reader_python
7 years ago
sneaxiy f85e16f1de Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into complete_py_reader_python
7 years ago
yuyang18 3aaf798182
Refine size_t and int
7 years ago
fengjiayi 6d6f49cd56 Merge remote-tracking branch 'yuyang/feature/decorated_reader_chain' into dev_reader_ResetAll
7 years ago
fengjiayi 611716e9bc Merge branch 'dev_reader_shutdown_start' of https://github.com/JiayiFeng/Paddle into dev_reader_shutdown_start
7 years ago
fengjiayi 0e9f1e2790 Make ReaderBase thread safe and remove ThreadedReader
7 years ago
yuyang18 e8ee9dc7f8
Several Polish
7 years ago
fengjiayi b4f0e57956 fix errors
7 years ago
fengjiayi 6fc6cc2f4c Some updates on readers
7 years ago
fengjiayi 5528f59900 Split ReInit() to Shutdown() and Start()
7 years ago
fengjiayi de9a411f1c adjust readers' inheritance relationships
7 years ago
yuyang18 c48c586aca
Use weak_ptr to implement DecoratedReaderChain
7 years ago
sneaxiy 739c330914 fix merge conflict
7 years ago
sneaxiy 01fbcb0bbb
Merge pull request #11695 from sneaxiy/complete_py_reader_cpp
7 years ago
sneaxiy d4d946db5a update blocking queue
7 years ago
sneaxiy 67556e4aa4 update blocking queue
7 years ago
sneaxiy 502faf62a9 complete_py_reader_cpp
7 years ago
sneaxiy 7b2339d7c5 delete create_py_array_reader_op.cc
7 years ago
sneaxiy 2dcf0e4e66 delete py_array_feed_queue.h
7 years ago
sneaxiy 9b63fef32d delete some redundant comments
7 years ago
sneaxiy 697ba4b13d Add Python array reader op
7 years ago
fengjiayi bc9d19c7d6 fix a bug
7 years ago
fengjiayi 32478fe0ea Make buffers of DoubleBufferReader and open_files bigger
7 years ago
fengjiayi e71948f167 Refine random crop
7 years ago
yuyang18 54002c3bab Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into feature/polish_doc
7 years ago
yuyang18 ff55d4c593 Polish documents
7 years ago
fengjiayi 499dbe0536 fix a multi-thread bug in readers
7 years ago
fengjiayi 3526ac1136 refine code
7 years ago
fengjiayi 744cc412b7 fix a bug
7 years ago
fengjiayi ee4e567dea Creating readers before training begining
7 years ago
fengjiayi 32c0e82ca0 fix two bugs
7 years ago
fengjiayi cd8700f172
Merge pull request #10872 from JiayiFeng/dev_CustomReader
7 years ago
fengjiayi 8147063539 follow comments
7 years ago
fengjiayi 0457f06434 add comments
7 years ago
fengjiayi e4e9d3624f fix a potential bug
7 years ago
fengjiayi 239546a6c1 add unit test and fix a bug
7 years ago
fengjiayi 2e42b31f45 refine code
7 years ago
fengjiayi 4b395b0809 fix errors
7 years ago
fengjiayi c2436f2ca5 expose random_data_generator
7 years ago
fengjiayi b48eba1902 complete python API and unit test
7 years ago
fengjiayi 983c9a2a30 Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into dev_CustomReader
7 years ago
fengjiayi e15d616e29 Complete the C++ core of 'CustomReader'
7 years ago
fengjiayi e61a38daa3 init CustomReader
7 years ago
Yu Yang 0e78cb69fb Clean OpProtoAndCheckerMaker
7 years ago
fengjiayi 71fa3ca9c4
Merge pull request #10232 from JiayiFeng/fix_unittests
7 years ago
fengjiayi 30f9dc92e5 fix errors
7 years ago
fengjiayi 330fa95cbd Follow comments
7 years ago
Abhinav Arora 83b1a8f6bf
Pending more CPPLint errors in fluid/operators/math (#10243)
7 years ago
Abhinav Arora f457d5da06
Fix more CPPLint errors (#10218)
7 years ago
fengjiayi 8bd34664f1 fix unit test error
7 years ago
fengjiayi 17c51d69d1 fix unit test error
7 years ago
fengjiayi 304b6b7138 Follow comments
7 years ago
fengjiayi 4cb63d8451 Remove unnecessary header files
7 years ago
fengjiayi e057ba6877 Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into blocking_queue_for_reader
7 years ago
fengjiayi e2ca42408b Replace Channel in DoubleBufferReader with BlockingQueue
7 years ago
fengjiayi a786611314 Replace Channel in MultiFileReader with BlockingQueue
7 years ago
fengjiayi 1a25f3cd07 Add reader blocking queue
7 years ago
Yu Yang 54ada9449e Add demo for recordio train/test and parallel executor
7 years ago
fengjiayi 9f11da5931 Add synchronous TensorCopy and use it in double buffer
7 years ago
fengjiayi 3fa0ef3d71 Refine double_buffer code
7 years ago