216 Commits (371f377beaf687946eeed8bf02c0cba257382f5f)

Author	SHA1	Message	Date
gongweibao	ad2bc0c364	Fix a distribution bug and cleanup some not need logs. (#22381)	5 years ago
Yiqun Liu	b7cac50b64	Implement a common python unittest to test the ir passes. (#22209) ... * Implement a common python unittest to test the ir passes. test=develop * Save the results in np.array and support to startup on CPU. test=develop * Fix the unittest. test=develop * Add check_program to check whether the optimized program is different from the origin one. test=develop * Remove the inferface all_ops. test=develop * Add exception test in pass_test. test=develop	5 years ago
tangwei12	82bc814a57	integrated HALF_ASYNC to communicator (#21869) ... * add half_async in the communicator * fix DistributedStrategy	5 years ago
Chen Weihang	35efbe6d95	Speeding up dygraph DataLoader with multiprocessing (#21762) ... * add multiprocess for dygraph data loader, test=develop * polish code & add safe gurad, test=develop * refactor dygraph dataloader & add signal handler, test=develop * fix member initializer compile error on ci, test=develop * fix member initializer compile error one more, test=develop * remove useless config, test=develop * skip windows incompatible problem, test=develop * add unittest for coverage, test=coverage * add more exception unittest case, test=develop * deal with signal handler coverage, test=develop * polish code & add signal handler tests, test=develop * deal with coverage ci problem, test=develop * split data loader test & coverage ci fix, test=develop * remove test_imperative_data_loader_with_exception, test=develop * remove singal process except test case, test=develop * add exception tests again & remove sample list test, test=develop * split normal and exception unittests to diff class, test=develop * polish doc for use_multiprocess effect in static mode, test=develop	5 years ago
liym27	d90c121534	Revert "open test_parallel_executor_fetch_feed for PR_Windows_CI. test=develop (#22020)" (#22253) ... This reverts commit c7b03d308c.	5 years ago
liym27	8de33f4197	add NotImplementedError for multi optimizers (#22181) ... * add NotImplementedError for multi optimizers used on multi-places . test=develop * assert error only if num_devices>1. test=develop * set test_optimizer_in_control_flow in CMakeLists for using multi-GPU.test=develop	5 years ago
Zhen Wang	46189b166d	Add bn and relu fuse pass (#22048) ... * add bn and relu fuse pass * add op attr assert and dtype assert * fix some inputs&&outputs bugs for the fused op and pattern. * add the unittest for fuse_bn_act_pass. test=develop * use normative enforce statements. test=develop * add the cpu test. test=develop * add the support of batch_size=1 for the bn with relu op. test=develop * add the error type for paddle throws. test=develop * add fused_batch_norm_act and fused_batch_norm_act_grad to op_has_unsed_vars_white_list. test=develop	5 years ago
songyouwei	0d82baf837	add batch_size_1_input data function for sequence ops unittests (#22172)	5 years ago
Zeng Jinle	c3bcd3c1e2	fix dygraph non zero gpu bug, test=develop (#22165)	5 years ago
Chengmo	418abc92f4	Update pyramid related OP (#21372) ... * add special way to add distribute vars， Update Pyramid hash op	5 years ago
liym27	c7b03d308c	open test_parallel_executor_fetch_feed for PR_Windows_CI. test=develop (#22020)	5 years ago
WangXi	3ec289a6a3	fix sync_batch_norm hang in fleet (#21838)	5 years ago
Kaipeng Deng	f4013ecb3b	enable kldiv_loss_op unittests (#21990)	5 years ago
WangXi	0d61653c8e	Revert to run distributed unittest serially, test=develop (#21924)	5 years ago
songyouwei	8439384e25	Move sequence op unittest files to a separate folder sequence (#21842) ... * move sequence op unittests to a separate folder test=develop * add missing CMakeList file test=develop * fix relative path import test=develop * fix relative import test=develop * use sys.path.append test=develop	5 years ago
WangXi	52a61edaad	rename test_dist_mnist & run dist parallel, test=develop (#21874)	5 years ago
gongweibao	855ed5fb3d	revert parallel test=develop (#21856)	5 years ago
WangXi	0fe16539ef	Fix dgc & launch tests in cpu ci (#21759)	6 years ago
gongweibao	549f24b5f1	run dist tests parallel(#21751)	6 years ago
juncaipeng	7c38612347	disable op test of kldiv_loss (#21749)	6 years ago
tangwei12	9ad940fdfe	memory leak for cpu (#21174) ... * add fake init for the trainer, fix large memory hold in the trainer * do not merge recv vars from a remote endpoint, test=develop * add recv and save op, merge slice var in one op, save memory * remove hsigmoid with pull sparse, test=develop	6 years ago
lilong12	0bc8bdf724	set dim[0] to -1 if dim[0] < 0 during compiling for c_allgather op (#21402) ... * set dim[0] to -1 if dim[0] < 0 and remove assertion to runtime, test=develop * modify ENFORCE message, test=develop * add validation for x.shape[0] > 0, test=develop * add ut, test=develop	6 years ago
hutuxian	47a82e38e3	Support data_norm gpu kernel (#21325) ... * support data_norm_op run in CUDA * add two parameters sync_stats & summary_decay_rate * add UT	6 years ago
Zeng Jinle	cdb3d27985	Fix warn of gcc8 (#21205) ... * fix warnings oof gcc 8 compilation, test=develop * fix boost::bad_get, test=develop * refine PADDLE_ENFORCE, test=develop	6 years ago
Dong Daxiang	a6747a6ef1	add launch_ps module so that we can launch a parameter server trainin… (#20936) ... * add launch_ps module so that we can launch a parameter server training job 1) a user can specify worker_num and server_num 2) parameter server can be killed after all workers exit 3) unit test is added test=develop	6 years ago
Aurelius84	aacd16dbb4	add pyramid_hash_op (#20698)	6 years ago
Tao Luo	efbdad0596	make search_compute support avx default (#20779) ... * make search_compute support avx only * clean search_compute.h * rename sse_axpy to avx_axpy test=develop * update CMakeLists.txt test=develop	6 years ago
WangXi	250e72d254	Fix DGC algorithm flow to make it the same as paper (#20758)	6 years ago
gongweibao	8088395a84	Set unique port to every distribute test to avoid potential port conflicts (#20759)	6 years ago
gongweibao	78431dc7bc	Add detail log on parallel dygraph unit test when failed. (#20660)	6 years ago
gongweibao	89c4b3ddcf	Add bash_test_modules function to capture the timeout or failed context. (#20197)	6 years ago
chengduo	0313b98ae0	temporally disable test_parallel_executor_fetch_feed in Windows CI (#20288) ... test=develop	6 years ago
Chengmo	728ec1b43d	Add GEO-SGD distribute training algorithm (#20018) ... * refector geo sgd & communicator	6 years ago
gongweibao	d4bca8118a	change dist tests to serial test=develop (#20051)	6 years ago
gongweibao	afc40a59eb	Add `RUN_SERIAL` attribute to `exclusive` test. (#20026)	6 years ago
ShenLiang	5920d69df5	Avoid treating broadcast as initialization operation (#19857) ... * treat broadcast as non-initial, test=develop * rename the class name * rename the class name, test=develop	6 years ago
Zeng Jinle	0436efd6a3	Unify DataLoader APIs (#19305) ... * unify DataLoader APIs, test=develop * integrate iterable CPU Dataset, test=develop add GPU dataset supporting, test=develop * add unittests for dataset, test=develop * add more docs to dataloader apis, test=develop, test=document_preview * refine doc, test=develop * refine doc again, test=develop * increase coverage, test=develop	6 years ago
Zeng Jinle	cee0079a4d	fix readers bug, test=develop (#19868)	6 years ago
Thunderbrook	bda92434db	remove trainer desc test in windows temporarily (#19753)	6 years ago
Zeng Jinle	bb4f8dee83	add logs to left var memory size, test=develop (#19722)	6 years ago
chengduo	2c30e64b2f	increase timelimit test_pe_serexnext (#19702) ... test=develop	6 years ago
chengduo	5c4eb394e9	Make test_pe_seresnext serial (#19634) ... * make test_pe_seresnext serial test=develop * Increase test_pe_seresnext time limit on MAC test=develop	6 years ago
Jiabin Yang	e9233d1c1e	Refactor dygraph (#19107) ... * refactor dygraph,test=develop * fix failed unittest,test=develop * polish code,test=develop * check windows ci error,test=develop try to fix windows ci error by np.allclose,test=develop * polish vlog and profiler, test=develop * try to fix preceding ops order,test=develop * test transformer in windows ci, test=develop * use python c-api to speed up tracer.trace,test=develop * test=develop, fix docker with paddle nccl problem * test=develop, add ut for debug string and gradient_accumulator * test=develop, add tests for layer/gradient_accumulator/prepared_op * test=develop, fix complie error for test_prepared_op * test=develop, add more ut for dygraph * test=develop, create API.spec for dygraph api change * test=develop, refoctor name to make it easier to understand * test=develop, refoctor name to make it easier to understand * test=develop, fix multi-gpu failed problem , add Tracer tests, change PADDLEENFORCE to PADDLEENFORCE_EQ * test=develop, fix ut failed on parallel se-resnext * test=develop, change one more PADDLE_ENFORCE	6 years ago
hutuxian	66ad68ed7b	Update UT test_boxps (#19599) ... Disable test_boxps in win32. Adjust filename to avoid latent multi-thread problem.	6 years ago
Tao Luo	49523ea189	replace PADDLE_ASSERT with PADDLE_ASSERT_MSG (#19586) ... * remove unused PADDLE_ASSERT(_IS_NOT_ERROR) * replace PADDLE_ASSERT with PADDLE_ASSERT_MSG test=develop	6 years ago
gongweibao	57f0f0f2dc	Delete pserver complete file before executor running. (#19468)	6 years ago
ShenLiang	85914f7a88	add gather_nd op and unit test (#19366) ... * fixed the code for coverage * fixed the document,test=document_preview test=develop	6 years ago
chengduo	e340df013e	Support feed single persistable variable to PE (#19417) ... * update executor feed	6 years ago
Yi Liu	efb05ba258	supports multiple NCCL communicators preserved in NCCLCommContext (#19407) ... * supports multiple NCCL communicators preserved in NCCLCommContext test=develop * add ut for c_comm_init_all operator and fix cuda resource release problem test=develop	6 years ago
chengduo	6a1632318d	Split test_parallel_executor_seresnext to three unit test (#19239) ... * increase test_parallel_executor_seresnext time limit test=develop * split test_parallel_executor_seresnext test=develop * temporally disable reduce_and_allreduce test because of the random failure. test=develop * split gpu and cpu test=develop	6 years ago