7 Commits (dd4c2d86a5f6df51091983b52badcad744548793)

Author	SHA1	Message	Date
xujiaqi01	d11c140e28	fix dump, fix cvm check (#25400) ... * fix dump, fix cvm check test=develop * fix test=develop * fix test=develop * fix test=develop	5 years ago
hutuxian	b8f17a049d	fix problem in dump and add log (#24891) ... * Fix the field length in LoD scenario * Fix the missed lod info when copy tensor in dump field * Add some log to make debug easy	5 years ago
123malin	9d2bd0ac38	downpour_worker增加try_catch机制，打印program所有参数 (#24700) ... * test=develop, add try_catch for debug	5 years ago
hutuxian	0ec3a42e97	Random Dump (#24477) ... * Refactor code for dump_field & dump_param: abstracting the common function in base class. * Support dump randomly & random with lineid * Support specify the random interval, which avoids printing too much logs.	5 years ago
123malin	00594c1c88	support dumping params/grads in transpiler mode (#22490)	6 years ago
jiaqi	3f8031e256	dataset (#17973) ... (1) use channel instead of vector/BlockingQueue in Dataset，to keep same with existing implementation, and make code more readable and flexible (dataset single output channel or multi output channel). one previous memory out of limit problem is cause by not release memory after training. (2) add Record because MultiSlotType costs too much memory (80B)，fix memory out of limit problem. (3) add Channel, Archive in paddle/fluid/framework (4) change dataset from shared_ptr to unique_ptr in pybind (5) move create/destroy readers from trainer to dataset (6) move shuffle from datafeed to dataset. dataset holds memory, datafeed is only for load data and feed data to network. (7) fix thread num bug of Dataset when filelist size < thread num (8) support set_queue_num in InMemoryDataset	6 years ago
dongdaxiang	24a8001142	make -DWITH_PSLIB=ON compilable	6 years ago