156 Commits (c5f47c2107143bc9da8295abb5e7203f74076aef)

Author	SHA1	Message	Date
guru4elephant	2efb282c86	split test_dist_se_resnext.py into 4 testcases (#18743) ... * split test_dist_se_resnext.py into 4 testcases	6 years ago
Bob Zhu	220eef602e	Extend Matmul to support matrix multiplication with multiple heads (#18570) ... * extend matmul op to support multiple head multiplication With the support of multiple head, the multiplication of two big matrixes is split into multiplication of several (head_number) small matrixes. e.g. if Mat A is [3, 24] and Mat B is [24, 4], when multiple A and B with head_number as 4, Mat A will be split as 4 matrix of [3, 6] and Mat B will be 4 matrix of [6, 4]. The result of final matrix will be 4 matrix of [3, 4], i.e. [3, 16].	6 years ago
guru4elephant	ebf9797ec3	split different comm method for mnist distributed training (#18715) ... * split different comm method for mnist distributed training	6 years ago
Zeng Jinle	ae58afc546	Feature/auto_growth_allocator (#18561) ... * feature/auto_growth_allocator, test=develop * add unittest of AlignedAllocator, test=develop * try to turn on auto_growth to test on CI, test=develop * fix segmentation fault in mixed_vector.h, test=develop * add unittests, test=develop	6 years ago
guru4elephant	b71b454328	increase timeout again (#18628) ... test=develop	6 years ago
kh2se2013	9ad57f2dfd	1）change to parallel mode on python coverage run (#18594) ... 2）add pip install coverage in Dockerfile.tmp test=develop	6 years ago
Zeng Jinle	d3003a1620	Feature/buffer_shared_inplace (#17911) ... * feature/buffer_shared_inplace, test=develop * refine code, test=develop * fix elementwise_add op cpu inplace and sum inplace bug, test=develop * add unittest and debug log, test=develop * fix parallel_executor scope bug, polish code, test=develop * fix sum op, activation op, single_in_place_inference bug, test=develop * remove kLocalExecScopeName, test=develop * fix unittest,test=develop * fix out_var first version bug, test=develop * follow comments,test=develop	6 years ago
kh2se2013	27fb9cad65	add WITH_COVERAGE option, default OFF (#17872) ... * add WITH_COVERAGE option, default OFF test=develop * add coverage for python sdk test=develop * fix code style * fix COVERAGE_FILE path test=develop * remove coverage package test=develop * test = develop, run coverage as module	6 years ago
HaoRen	b7128bac5f	supports collective communicated training (#18175) ... * fix prepare context redundant code problem, optimize executor by caching create_varaiables test=develop * supports collective training in executor * make fetch_list runable with variables, add more unittest for use_program_cache test=develop * fix comment test=develop * use unique name for nccl_id * supports output to stream in program_to_code * insert sync_comm_stream before regularization; add skip_op_callstack capability in program_to_code * set op role in collective training * add collective op role * remove orig file * add build optimizer by strategy * add collective strategy * refine collective strategy * add multi-process role maker * refine strategy building factory so that we can easily plugin more strategy * scale loss grad in collective sgd transpiler * add support for distributed fc * code format * revert some features for dist fc * add support for distributed fc training * fix prepare context redundant code problem, optimize executor by caching create_varaiables test=develop * supports collective training in executor * make fetch_list runable with variables, add more unittest for use_program_cache test=develop * use unique name for nccl_id * supports output to stream in program_to_code * insert sync_comm_stream before regularization; add skip_op_callstack capability in program_to_code * set op role in collective training * add collective op role * fix comment test=develop * remove orig file * add build optimizer by strategy * add collective strategy * refine collective strategy * add multi-process role maker * refine strategy building factory so that we can easily plugin more strategy * scale loss grad in collective sgd transpiler * add support for distributed fc * code format * revert some features for dist fc * add support for distributed fc training * test=develop add collective op unittest standard * test=develop remove the test_collective directory * test=develop remove the test_collective directory * remove slicegather test * code format for reducescatter * update attr of shard_index_op * Modify macro nccl_helper * remove test without distribute * macro collective_helper * marcro update * test=develop update support python3.5 * test=develop change gpu memory use to 0.1 when test * test=develop update ut equal func * test=develop set flags to 1.5 * test=develop fix pickle dumple py35 * test=develop fix divide in slice and add sync_comm_stream update atol and rtol to 1e-05 rm shard_index op and test modify read input from file to read from memory remove origin_program in framework and add i/o in c_sync_calc_stream * test=develop update unittest sync operator I/O	6 years ago
hutuxian	e42057cd1a	add ut for pipeline training (#18289)	6 years ago
Jiabin Yang	bd61d89925	test=develop, recover ocr ut on dygraph (#18166)	6 years ago
Jiabin Yang	79bcdbbf1a	test=develop, disable basic gru related ut (#18329)	6 years ago
Hongyu Liu	df2eee71d8	Sequence mask support tensor (#18249) ... * sequnce mask support max length tensor input; test=develop * add rnn_impl.py; test=develop * add basic gru lstm unittest; test=develop * fix api spec; test=develop * fix sequence_mask op bug; test=develop test=document_preview * change +-*x to elmentwise_op; test=develop * add mkl flag; test=develop * fix rnn impl bug; test=develop * update api spec; test=develop * fix doc bug; test=develop * fix lstm bugs; test=develop	6 years ago
guru4elephant	7d76e34ec2	add more print function for timeout issue, make timeout value larger (#18219) ... * add more print function for timeout issue, make timeout value larger	6 years ago
Jiabin Yang	b3cbc5be76	test=develop, fix test_imperative_transformer and ocr (#18127) ... * test=develop, fix test_imperative_transformer and ocr * test=develop, remove ocr recovery part	6 years ago
Qiao Longfei	778f6acf4d	disable test_async_ssa_graph_executor_mnist test=develop (#18165)	6 years ago
Jiabin Yang	991c94f135	test=develop, add add_multi_gpu_install_check (#18157) ... * test=develop, add add_multi_gpu_install_check * test=develop, refine warning doc * test=develop, refine warning doc * test=develop, refine warning doc * test=develop, support multi cpu	6 years ago
chengduo	4978db2c10	Remove nccl dep when the number of GPU is 1 (#18158) ... * remove nccl dep when the number of GPU is 1 test=develop	6 years ago
tangwei12	101f74cb19	fix save/load in fleet (#17675) ... * fix save/load in Fleet * add UT framework of Fleet	6 years ago
gongweibao	fbbdc9ccad	Add backward and optimizer operator dependency pass. (#17746)	6 years ago
Huihuang Zheng	83e51ded21	SERIAL flaky imperative unit tests for CI cuda9 (#17892) ... test=develop	6 years ago
gongweibao	6a1df46991	Fine tuning launch.py (#17223)	6 years ago
lilong12	bfcc97d924	Split the unittest test_dist_mmist into multiple unittests (test_dist_mnist, test_dist_mnist_nccl and test_dist_mnist_lars) to avoid timeout (#17707)	6 years ago
Hongyu Liu	552f8395a3	remove ocr unit test; test=develop (#17755)	6 years ago
Hongyu Liu	0a02451ea0	fix ocr; test=develop (#17751)	6 years ago
Jiabin Yang	33a791dd81	test=develop, add ocr in dygraph test (#17470) ... * test=develop, add ocr in dygraph test * test=develop, add cudnn determinist * test=develop, remove useless code * test=develop, fix cmake error	6 years ago
Jiabin Yang	3ee3611aa7	test=develop, fix test_imperative_resnet failed on CI (#17583)	6 years ago
Tao Luo	3d19f44a89	remove unused SERIAL compiler option (#17500) ... test=develop	6 years ago
Jiabin Yang	4624d7c642	test=develop, add gradient sort backward strategy (#17125) ... * test=develop, add gradient sort backward strategy * test=develop, fix test by add FLAGS_cudnn_deterministic on new tests	6 years ago
Tao Luo	ff1661f12a	remove unused FLAGS_warpctc_dir (#17162) ... * remove unused FLAGS_warpctc_dir test=develop * remove FLAGS_warpctc_dir test=develop	6 years ago
wopeizl	83c4f7721f	use two GPUs to run the exclusive test test=develop (#17187)	6 years ago
tianshuo78520a	8092c40560	Modify test timeout (#17181) ... * test=develop * test=deelop	6 years ago
Yan Xu	0b07eef118	ParallelDyGraph with GPU collective mode (#16827) ... implement dygraph.parallel.DataParallel to hook reduce op.	6 years ago
tangwei12	e707119a89	remove ut test_dist_word2vec in mac ci, will fix it in private, test=develop (#17066)	6 years ago
qingqing01	c1c2633a63	Support backward of backward for Relu and add a new gradient checker by comparing theoretical and numerical Jacobian. (#16862) ... * Support backward of backward and a new gradient checker * Rename decorators.py to decorator_helper.py, since Python on Windows CI has decorators package. 1. Add ReluDoubleGradMaker when register relu_grad. 2. Add a new gradient checker by comparing theoretical and numerical Jacobian. Check double gradients by double_grad_check.	6 years ago
Zeng Jinle	f188b3708e	Move gc test to each test of op (#16999) ... * move gc test to op_test test=develop * Revert "move gc test to op_test" This reverts commit cf15da65c38f57c91f53b3d8b3c2365d4aa86016. * enable gc test in some ops test=develop	6 years ago
wopeizl	d9991dccdd	add parallel build script to ci … (#16901) ... * add parallel build script to ci test=develop * 1. classify the test case as single card/two cards/multiple cards type 2. run test case according to the run type	6 years ago
gongweibao	cbdb8a17b1	Polish DGC code (#16818)	6 years ago
gongweibao	b7f20ed6af	Fix unittest dataset error (#16925)	6 years ago
chengduo	c62674f475	Refine StaticRnn (#16707) ... * enable recurrent op test=develop	6 years ago
Tao Luo	7d0ed2a423	remove non-existent test_image_classification_resnet ... test=develop	6 years ago
chengduo	ea8655dbd2	Add unit test for fuse_opt_ops (#16550) ... * add unit test for fuse_opt_ops test=develop	6 years ago
lujun	ad7c1a934f	merge conficts, test=develop	6 years ago
Yan Xu	2e1e76e70e	add SeResNeXt unittest (#16503) ... * add seresnet unittest test=develop * add dropout layer test=develop * fix ci test=develop * fix comment test=develop * fix comment test=develop * fix ci test=develop * fix ci test=develop * fix ci * fix module name test=develop * run imperative serenext unit test serially test=develop	6 years ago
lujun	04c0b12c6e	fix test layers error, test=develop	6 years ago
lujun	cf642d478d	fix merge for move dir, fix utest error, test=develop	6 years ago
minqiyang	35c89f38c3	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into imperative_lr_scheduler ... test=develop	6 years ago
gongweibao	eb83abeac3	Add DGC(Deep Gradient Compression) interface. (#15841)	6 years ago
minqiyang	b5bbb13ac1	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into imperative_lr_scheduler	6 years ago
chengduo	c917c13af1	increase the time limite (#16405) ... test=develop	6 years ago