258 Commits (8439384e257f6a69b6afe5d1944cdf1a0c4af3c2)

Author	SHA1	Message	Date
Qiao Longfei	d981333e94	add a base class for reader	7 years ago
Qiao Longfei	a06173eedc	clean code	7 years ago
Qiao Longfei	71c2ad412f	complete read thread	7 years ago
Qiao Longfei	0f3ece775d	use gzstream	7 years ago
Qiao Longfei	a1e0f5abb7	add gzstream.cmake	7 years ago
Qiao Longfei	20f181cdc1	init ctr_reader	7 years ago
Tao Luo	e47f4186ae	fix some compiler warning	7 years ago
Qiao Longfei	d26e4507da	init ctr data	7 years ago
Qiao Longfei	60030e8678	change the use of FLAGS_reader_queue_speed_test_mode ... test=develop	7 years ago
Qiao Longfei	c61e16b181	add reader_queue_speed_test_mode_flag test	7 years ago
Qiao Longfei	8686f7c68e	add reader_queue_speed_test_mode flag for speed test	7 years ago
Yu Yang	21387e3c2a	Tiny refines for lod_tensor_blocking_queue and reshape_op	7 years ago
fengjiayi	060f421797	Some enhancement on readers ... 1. Make the feeding thread of py_reader a daemon thread. 2. Update buffer_reader's destructor, fixing a bug. 3. Make pyreader demo script supporting CPU environment.	7 years ago
yuyang18	8c70183ba6	Polish function names	7 years ago
yuyang18	b789a3a484	Change code	7 years ago
yuyang18	401e92f6e3	Change attr comment	7 years ago
yuyang18	72b78154b2	Polish reader speed	7 years ago
yuyang18	e576345f5b	Try to speed up buffered reader	7 years ago
yuyang18	61b3a5977f	Refine Python Reader	7 years ago
yuyang18	b048ddf0bd	Merge error	7 years ago
yuyang18	d36e13efd8	Merge branch 'feature/add_pyreader_demo' into feature/combine_open_files_and_double_buffer	7 years ago
yuyang18	1478a5fc0b	Make open_files use buffer	7 years ago
yuyang18	dc34effd35	Extract buffered reader	7 years ago
yuyang18	392318045f	Merge branch 'feature/dctor_all_readers' into feature/combine_open_files_and_double_buffer	7 years ago
yuyang18	fecbe52200	Rewrite open_files	7 years ago
Yu Yang	ba997b8ccd	Merge pull request #12097 from reyoung/feature/hide_api_cont ... Hide internal API of LoDTensors, Clipping, etc.	7 years ago
yuyang18	c680bc1d7f	Rewrite DoubleBuffer	7 years ago
yuyang18	c9cf2bdb9c	Dctor cache	7 years ago
yuyang18	ee7d8b4d66	Refine Shutdown Impl	7 years ago
sneaxiy	31c7f6b968	Merge branch 'develop' into complete_py_reader_python	7 years ago
sneaxiy	f85e16f1de	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into complete_py_reader_python	7 years ago
yuyang18	3aaf798182	Refine size_t and int	7 years ago
fengjiayi	6d6f49cd56	Merge remote-tracking branch 'yuyang/feature/decorated_reader_chain' into dev_reader_ResetAll	7 years ago
fengjiayi	611716e9bc	Merge branch 'dev_reader_shutdown_start' of https://github.com/JiayiFeng/Paddle into dev_reader_shutdown_start	7 years ago
fengjiayi	0e9f1e2790	Make ReaderBase thread safe and remove ThreadedReader	7 years ago
yuyang18	e8ee9dc7f8	Several Polish	7 years ago
fengjiayi	b4f0e57956	fix errors	7 years ago
fengjiayi	6fc6cc2f4c	Some updates on readers ... 1. Shrink DoubleBufferReader's buffer size to 3. 2. Add BatchReader an option to discard leftover instances. 3. Fix a MultiPassReader bug on pass count.	7 years ago
fengjiayi	5528f59900	Split ReInit() to Shutdown() and Start()	7 years ago
fengjiayi	de9a411f1c	adjust readers' inheritance relationships ... 1. Make PyReader and RandomDataGenerator inherited from FileReader. 2. Remove the memeber variable 'dims_' and realated checks in FileReader.	7 years ago
yuyang18	c48c586aca	Use weak_ptr to implement DecoratedReaderChain	7 years ago
sneaxiy	739c330914	fix merge conflict	7 years ago
sneaxiy	01fbcb0bbb	Merge pull request #11695 from sneaxiy/complete_py_reader_cpp ... Add Python Reader Op (CPP side)	7 years ago
sneaxiy	d4d946db5a	update blocking queue	7 years ago
sneaxiy	67556e4aa4	update blocking queue	7 years ago
sneaxiy	502faf62a9	complete_py_reader_cpp	7 years ago
sneaxiy	7b2339d7c5	delete create_py_array_reader_op.cc	7 years ago
sneaxiy	2dcf0e4e66	delete py_array_feed_queue.h	7 years ago
sneaxiy	9b63fef32d	delete some redundant comments	7 years ago
sneaxiy	697ba4b13d	Add Python array reader op	7 years ago
fengjiayi	bc9d19c7d6	fix a bug	7 years ago
fengjiayi	32478fe0ea	Make buffers of DoubleBufferReader and open_files bigger	7 years ago
fengjiayi	e71948f167	Refine random crop ... 1. Add a new attribute named 'startuo_seed' to RandomCropOp. If the input 'Seed' is not initialized, the 'startup_seed' will be used to replace it. 2. Refine CustomReader. Add a member variable 'scope_' to it. The 'scope_' will act as the global scope of preprocesing, making it possiable to save something cross batches.	7 years ago
yuyang18	54002c3bab	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into feature/polish_doc	7 years ago
yuyang18	ff55d4c593	Polish documents ... * less_than * cumsum * multiplex * open_recordio_file	7 years ago
fengjiayi	499dbe0536	fix a multi-thread bug in readers	7 years ago
fengjiayi	3526ac1136	refine code	7 years ago
fengjiayi	744cc412b7	fix a bug	7 years ago
fengjiayi	ee4e567dea	Creating readers before training begining	7 years ago
fengjiayi	32c0e82ca0	fix two bugs	7 years ago
fengjiayi	cd8700f172	Merge pull request #10872 from JiayiFeng/dev_CustomReader ... CustomReader	7 years ago
fengjiayi	8147063539	follow comments	7 years ago
fengjiayi	0457f06434	add comments	7 years ago
fengjiayi	e4e9d3624f	fix a potential bug	7 years ago
fengjiayi	239546a6c1	add unit test and fix a bug	7 years ago
fengjiayi	2e42b31f45	refine code	7 years ago
fengjiayi	4b395b0809	fix errors	7 years ago
fengjiayi	c2436f2ca5	expose random_data_generator	7 years ago
fengjiayi	b48eba1902	complete python API and unit test	7 years ago
fengjiayi	983c9a2a30	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into dev_CustomReader	7 years ago
fengjiayi	e15d616e29	Complete the C++ core of 'CustomReader'	7 years ago
fengjiayi	e61a38daa3	init CustomReader	7 years ago
Yu Yang	0e78cb69fb	Clean OpProtoAndCheckerMaker ... Do not use ctor * Reduce line of codes. * We can use virtual function for Maker now. * The implementation does not care what maker holds, it is easier to refactor later.	7 years ago
fengjiayi	71fa3ca9c4	Merge pull request #10232 from JiayiFeng/fix_unittests ... Fix unittests	7 years ago
fengjiayi	30f9dc92e5	fix errors	7 years ago
fengjiayi	330fa95cbd	Follow comments	7 years ago
Abhinav Arora	83b1a8f6bf	Pending more CPPLint errors in fluid/operators/math (#10243) ... * Fix CPPLint issue in test_engine * Fix CPPLint errors in operators/math * Fix compilation	7 years ago
Abhinav Arora	f457d5da06	Fix more CPPLint errors (#10218) ... * Fix more CPPLint issues * Fix more CPPLint issues * Fix more CPPLint issues * Fix CPPLint issues in operators/math and operators/reader	7 years ago
fengjiayi	8bd34664f1	fix unit test error	7 years ago
fengjiayi	17c51d69d1	fix unit test error	7 years ago
fengjiayi	304b6b7138	Follow comments	7 years ago
fengjiayi	4cb63d8451	Remove unnecessary header files	7 years ago
fengjiayi	e057ba6877	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into blocking_queue_for_reader	7 years ago
fengjiayi	e2ca42408b	Replace Channel in DoubleBufferReader with BlockingQueue	7 years ago
fengjiayi	a786611314	Replace Channel in MultiFileReader with BlockingQueue	7 years ago
fengjiayi	1a25f3cd07	Add reader blocking queue	7 years ago
Yu Yang	54ada9449e	Add demo for recordio train/test and parallel executor	7 years ago
fengjiayi	9f11da5931	Add synchronous TensorCopy and use it in double buffer	7 years ago
fengjiayi	3fa0ef3d71	Refine double_buffer code	7 years ago
fengjiayi	7a78294666	Remove Readers' HasNext()	7 years ago
fengjiayi	a84b81502c	Remove Readers' HasNext()	7 years ago
JiayiFeng	ee178d5aeb	fix bugs	7 years ago
fengjiayi	5416bac5d8	Make shared decorated readers' creater be only in main_program	7 years ago
fengjiayi	6be51f10ec	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into modify_readers_to_fit_parallel_executor	7 years ago
fengjiayi	38ba7e5af4	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into update_reader	7 years ago
fengjiayi	49ab52d64d	Modify MultipleReader ... 1. Removes MultipleReader's multi-thread support, for we have got ThreadedReader. 2. Rename MultipleReader to MultiFileReader	7 years ago
JiayiFeng	03ff0e58fe	fix compile errors	7 years ago
fengjiayi	8fed780f14	Complete threaded reader	7 years ago
fengjiayi	442c150333	a draft of ThreadedReader	7 years ago
fengjiayi	af24290123	Add 'buffer_size' api for open_files op	7 years ago
fengjiayi	8441347808	fix lint	7 years ago
fengjiayi	a122dcccd5	fix lint	7 years ago
fengjiayi	3cd9e450ac	fix lint	7 years ago
fengjiayi	f2c0b88649	Merge pull request #9550 from JiayiFeng/make_MultipleReader_thread-safe ... Make MultipleReader thread-safe	7 years ago
fengjiayi	44d5f42a7e	update reader	7 years ago
Yi Wang	736950603e	Resolve conflicts	7 years ago
fengjiayi	b94f24d44f	Move StartPrefetcher and EndPrefetcher to private	7 years ago
fengjiayi	2945a98eb3	Make MultipleReader thread-safe	7 years ago
JiayiFeng	597c845c99	fix typo	7 years ago
JiayiFeng	c0257f0a5b	Add comments	7 years ago
JiayiFeng	5aa440fd7a	Add move constructor for Item	7 years ago
JiayiFeng	a469666e42	fix compile errors	7 years ago
fengjiayi	55e4b89f14	remove local_buffer_	7 years ago
fengjiayi	7bb18433fd	refine code	7 years ago
Yu Yang	53fa7cb9cc	Add local cache of double buffer reader	7 years ago
Yang Yu	af230d9bef	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into cpp_parallel_executor	7 years ago
fengjiayi	1a4b0d63e4	Merge pull request #9352 from JiayiFeng/doc_update_reader_doc ... Update c++ readers doc	7 years ago
Yang Yu	b0775588c0	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into cpp_parallel_executor	7 years ago
Abhinav Arora	65534c4762	Fluid channels should match the semantics of Go Channels (#9265) ... * Fluid Channel should match Go Channel in Semantics * Fix Python channel_send * Address code rveiew feedback * Fix open_files_op.cc * Add description to Channel Asserts	7 years ago
Yu Yang	02aaecca35	Fix CPU compile	7 years ago
Yu Yang	50e7e25db3	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into cpp_parallel_executor	7 years ago
fengjiayi	dd532e2086	refine MultiPassReader's doc string	7 years ago
fengjiayi	809530f418	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into dev_MultiEpochReader	7 years ago
fengjiayi	91b6d60003	Merge branch 'fix_bug_in_recordio' into dev_MultiEpochReader	7 years ago
fengjiayi	2532b922dc	Add more unittests and fix bugs	7 years ago
fengjiayi	f863866471	Add an unitest	7 years ago
fengjiayi	02b7d8bea5	Merge branch 'fix_bug_in_recordio' into dev_MultipleReader	7 years ago
fengjiayi	a2981f5c50	fix a bug	7 years ago
fengjiayi	6f7e812bb3	fix bugs	7 years ago
fengjiayi	d9868b0839	Add multi_pass_reader	7 years ago
fengjiayi	07d38a9b9a	refine patch	7 years ago
fengjiayi	a571ef382e	fix bugs	7 years ago
fengjiayi	3d677b1eca	fix compile errors and make OpenFilesOpMaker derived from FileReaderMakerBase	7 years ago
fengjiayi	550622529c	Add MultipleReader and open_files_op	7 years ago
Yu Yang	5e87cd7574	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into cpp_parallel_executor	7 years ago
Yu Yang	8b397d1602	Make recordio file reader thread-safe by default	7 years ago
Yu Yang	d84ddcf123	Stash	7 years ago
Yu Yang	164f2382af	Polish code	7 years ago
Yu Yang	e13aec601a	Merge pull request #8830 from reyoung/feature/recordio_file_reader ... Feature/recordio file reader	7 years ago
Yu Yang	f9974a4a12	Make double_buffer reader async	7 years ago
Yu Yang	a8c076e577	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into feature/shuffle_reader	7 years ago
Yu Yang	225efa671f	Remove dims in base class	7 years ago
Yu Yang	2ea4a5d96c	Polish double buffer reader	7 years ago
Yu Yang	46ae4075ee	Polish ShuffleReader and test	7 years ago
Yu Yang	7eedced82a	Polish RecordIO	7 years ago
Yu Yang	cfca8a3a26	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into feature/recordio_file_reader	7 years ago
Yu Yang	fea43077f6	Refine	7 years ago
fengjiayi	614c33fb3a	fix a potential bug in the c++ reader	7 years ago
fengjiayi	35e1e0d521	uses channel to replace the traditional buffer	7 years ago
fengjiayi	b3a11fdf3a	Merge branch 'rm_reader_HasNext' into dev_double_buffer_for_cpp_reader	7 years ago