4777 Commits (6e0df3102ec586279d3dbcb5fc528d656f372e84)

Author	SHA1	Message	Date
hutuxian	6e0df3102e	Refactor for Pipeline Thread Check (#18459) ... move the thread-check code from train_from_dataset to a single function add UT for the thread check function	6 years ago
Zeng Jinle	41ab76e55b	add friendly error msg to py_reader (#18316)	6 years ago
Kaipeng Deng	823ab5e887	fix load attr error. test=develop (#18447)	6 years ago
Yi Liu	a873fa84ce	supports collective training with programs (#18392) ... 1. Since allreduce op has 4 reduce types, We split these four reduce types into four ops 2. We also refined the collective op code, e.g. we separated the collective op kernel into CPUKernel and CUDAKernel, and remove the device specified DeviceContext parameter in template as we already knew the target DeviceContext 3. We remove the newly added Collective op role to reduce the complexity of program and graph analysis	6 years ago
guru4elephant	357311fdb7	make fleet support mpi job submit directly (#18441) ... make fleet support mpi job submit directly.	6 years ago
chengduo	e0d8c6ac68	Add find_no_grad_vars in backward.py (#17942) ... * add not_been_used_vars to no_grad_set test=develop	6 years ago
LielinJiang	449c7a9f98	Make roi_perspective_transform op return mask and transform matrix (#18371) ... * modify roi_perspective_transform_op to output mask and transform matrix * modify comment * modify comment * modify API.spec * update API.spec * remove no use header, test=develop * resolve conflict	6 years ago
tensor-tang	a3bc804f5f	fix mac ci random fail (#18430) ... * fix mac ci random fail * use platform instead	6 years ago
xsrobin	47e2ef38e9	add "import paddle.fluid as fluid" to examples lack of it	6 years ago
hutuxian	8a39e5c110	update api format (#18413) ... * update api format test=develop * update API.spec test=develop	6 years ago
Jie Fang	2b4ef509ea	init custom black white list (#18377) ... test=develop	6 years ago
guru4elephant	e83f902b98	add MultiSlotStringDataGenerator for speedup of string based user inp… (#18390) ... * add MultiSlotStringDataGenerator for speedup of string based user input data	6 years ago
Jiabin Yang	43f64a177e	Fix/program doc (#17908) ... * test=develop, add some comments for Program.clone * test=develop, add API.spec * test=develop, refine comments * refine Program doc and clone doc * test=develop, refine doc	6 years ago
chengduo	871cc15e6a	Add is_compiled_with_cuda (#18356) ... * add cuda_is_available test=develop * Fix api.spec test=develop * fix api doc test=develop	6 years ago
Wojciech Uss	8ed819d8e4	Call the test_slim_int8_* tests through absolute path (#18386) ... test=develop	6 years ago
lujun	fd6631ef2f	Fix dygraph show style (#18297) ... Fix dygraph show style for FluidDoc.	6 years ago
翟飞跃	19da59ed3f	Remove all the code, API and doc of MKL-DNN INT8v1 (#18347)	6 years ago
chengduo	8ed33bf91f	Fix Bug-prone code of PE (#18354) ... * update pe reduce config test=develop * drop the local_exe_scopes of the previous parallel_executor test=develop	6 years ago
tangwei12	999d9a59a5	fix communicator with pyreader (#18350) ... * add is_runnning in communicator, test=develop	6 years ago
kh2se2013	27fb9cad65	add WITH_COVERAGE option, default OFF (#17872) ... * add WITH_COVERAGE option, default OFF test=develop * add coverage for python sdk test=develop * fix code style * fix COVERAGE_FILE path test=develop * remove coverage package test=develop * test = develop, run coverage as module	6 years ago
HaoRen	b7128bac5f	supports collective communicated training (#18175) ... * fix prepare context redundant code problem, optimize executor by caching create_varaiables test=develop * supports collective training in executor * make fetch_list runable with variables, add more unittest for use_program_cache test=develop * fix comment test=develop * use unique name for nccl_id * supports output to stream in program_to_code * insert sync_comm_stream before regularization; add skip_op_callstack capability in program_to_code * set op role in collective training * add collective op role * remove orig file * add build optimizer by strategy * add collective strategy * refine collective strategy * add multi-process role maker * refine strategy building factory so that we can easily plugin more strategy * scale loss grad in collective sgd transpiler * add support for distributed fc * code format * revert some features for dist fc * add support for distributed fc training * fix prepare context redundant code problem, optimize executor by caching create_varaiables test=develop * supports collective training in executor * make fetch_list runable with variables, add more unittest for use_program_cache test=develop * use unique name for nccl_id * supports output to stream in program_to_code * insert sync_comm_stream before regularization; add skip_op_callstack capability in program_to_code * set op role in collective training * add collective op role * fix comment test=develop * remove orig file * add build optimizer by strategy * add collective strategy * refine collective strategy * add multi-process role maker * refine strategy building factory so that we can easily plugin more strategy * scale loss grad in collective sgd transpiler * add support for distributed fc * code format * revert some features for dist fc * add support for distributed fc training * test=develop add collective op unittest standard * test=develop remove the test_collective directory * test=develop remove the test_collective directory * remove slicegather test * code format for reducescatter * update attr of shard_index_op * Modify macro nccl_helper * remove test without distribute * macro collective_helper * marcro update * test=develop update support python3.5 * test=develop change gpu memory use to 0.1 when test * test=develop update ut equal func * test=develop set flags to 1.5 * test=develop fix pickle dumple py35 * test=develop fix divide in slice and add sync_comm_stream update atol and rtol to 1e-05 rm shard_index op and test modify read input from file to read from memory remove origin_program in framework and add i/o in c_sync_calc_stream * test=develop update unittest sync operator I/O	6 years ago
qingqing01	9047ac687e	Simplify multi_box_head API in detection.py and remove assign op. (#18310) ... * Simplify multi_box_head API in detection.py and remove assign op.	6 years ago
hutuxian	e42057cd1a	add ut for pipeline training (#18289)	6 years ago
Jiabin Yang	bd61d89925	test=develop, recover ocr ut on dygraph (#18166)	6 years ago
Yibing Liu	23941e43ec	Update lamb optimizer (#18333) ... * Update lamb optimizer test=develop, test=document_preview * Regenerate api spec test=develop, test=document_preview	6 years ago
whs	1bdfd2eb85	Fix checkpoint of Light-NAS (#18330) ... Socket can't be pickled. test=develop	6 years ago
Jiabin Yang	79bcdbbf1a	test=develop, disable basic gru related ut (#18329)	6 years ago
Jiabin Yang	831a3e62ca	Add install check for multigpu (#18323) ... * test=develop, add_install_check_for_multigpu * test=develop, refine code to use cuda_devices	6 years ago
Zeng Jinle	f88e07a0d3	fix lod_tensor.py grammar error, test=develop (#18308)	6 years ago
Hongyu Liu	df2eee71d8	Sequence mask support tensor (#18249) ... * sequnce mask support max length tensor input; test=develop * add rnn_impl.py; test=develop * add basic gru lstm unittest; test=develop * fix api spec; test=develop * fix sequence_mask op bug; test=develop test=document_preview * change +-*x to elmentwise_op; test=develop * add mkl flag; test=develop * fix rnn impl bug; test=develop * update api spec; test=develop * fix doc bug; test=develop * fix lstm bugs; test=develop	6 years ago
Jiabin Yang	9cb799be50	test=develop, Revert "Add multi gpu install check" (#18313) ... * Revert "Add multi gpu install check (#18229)" This reverts commit 61ed06b29a. * test=develop, start ci	6 years ago
Qiao Longfei	0e08e91c18	optimize communicator merge sparse gradient test=develop (#18159) ... * optimize communicator merge sparse gradient test=develop * revert multithread selected rows merge add test=develop * follow comment test=develop	6 years ago
Jie Fang	172c2facef	init black/white lists (#17847) ... test=develop	6 years ago
chengduo	e06c69c788	Fix default value of fluid.memory_optimize (#18295) ... * fix default value of fluid.memory_optimize test=develop * fix api.spec test=develop	6 years ago
Zhaolong Xing	6978b2e48e	fix split and sampled softmax (#18280) ... test=develop	6 years ago
hutuxian	6ed73830c2	add api desc for pipeline training (#18293)	6 years ago
liuwei1031	a736c03b10	improve doc of lstm, sequence_enumerate, softmax_with_cross_entropy, space_to_depth APIs (#18261) ... * improve doc of lstm, sequence_enumerate, softmax_with_cross_entropy, space_to_depth APIs, test=develop * update API.spec, test=develop	6 years ago
chengduo	d54e13bbec	add random seed for recurrent op test (#18274) ... test=develop	6 years ago
liuwei1031	4151d90c16	improve the hint message of memory optimize, test=develop (#18260)	6 years ago
guru4elephant	ff399fd720	fix paddle cloud role maker bug (#18269) ... * fix paddle cloud role maker bug	6 years ago
Yibing Liu	412951d7d2	Fix ema's example & fp16 update (#18273) ... test=develop, test=document_preview	6 years ago
flame	fdf798f95a	fix double buffer example (#18169) ... test=develop test=document_preview	6 years ago
Bai Yifan	23b8b18e56	fix api doc example, test=develop (#18266)	6 years ago
pkpk	cd9d57f5e0	fix a bug in examples of metrics.Acc	6 years ago
tensor-tang	68da8b2a01	refine core cmake warning and print more info (#18248) ... * refine core cmake warning and print more info test=develop * fix comments test=develop	6 years ago
zhaoyuchen2018	32c95f1752	Add StaticRNN.output code example (#18251) ... refine StaticRNN api doc test=develop test=document_preview	6 years ago
xiaoting	2f0d68261c	fix yolo_box example,test=develop (#18247)	6 years ago
songhao	6b3d96254d	fix some bug when merge sparse embedding parameters, test=develop (#18223) ... 1. fix the bug that out_put_var in SaveSelectedRows would be empty string 2. use merge_sparse_lookup_table to replace sum op for load_persistables_for_inference 3. fix the bug in _clone_var_in_block_ when the var is SELECTED_ROWS.	6 years ago
jiaqi	3f8031e256	dataset (#17973) ... (1) use channel instead of vector/BlockingQueue in Dataset，to keep same with existing implementation, and make code more readable and flexible (dataset single output channel or multi output channel). one previous memory out of limit problem is cause by not release memory after training. (2) add Record because MultiSlotType costs too much memory (80B)，fix memory out of limit problem. (3) add Channel, Archive in paddle/fluid/framework (4) change dataset from shared_ptr to unique_ptr in pybind (5) move create/destroy readers from trainer to dataset (6) move shuffle from datafeed to dataset. dataset holds memory, datafeed is only for load data and feed data to network. (7) fix thread num bug of Dataset when filelist size < thread num (8) support set_queue_num in InMemoryDataset	6 years ago
liuwei1031	5d54ed4a84	improve the doc of DataFeeder and default_main_program (#18241) ... * improve the doc of DataFeeder and default_main_program * update API.spec, test=develop	6 years ago