344 Commits (9ee288ac87c5bb204830f1ebee51be3cfefc4da0)

Author	SHA1	Message	Date
tangwei12	a010d883b4	doc fix, test=develop, test=document_fix (#20239) ... * doc fix, test=develop, test=document_fix	5 years ago
Chengmo	494d6cf252	Fix transpiler en doc (#20149) ... * test=develop,test=document_fix,fix transpiler doc,add API.spec	5 years ago
Chengmo	eb05db7104	Speed GEO-SGD (#20158) ... * delete debug vlog & add rpc function & fix word2vec bug & speed GEO-SGD	5 years ago
tangwei12	b5a410466c	Trainer heartbeat for async mode (#19600) ... Heartbeat for distributed async training.	5 years ago
Chengmo	728ec1b43d	Add GEO-SGD distribute training algorithm (#20018) ... * refector geo sgd & communicator	5 years ago
Zeng Jinle	5f2290ab84	Add deprecated memory optimize doc (#20111) ... * add deprecated memory optimize doc, test=develop, test=document_fix * merge develop to solve conflict, test=develop, test=document_fix	5 years ago
123malin	6c74e7387f	fix APIs, test=document_preview (#19954) ... * fix DistributeTranspilerConfig document, test=develop	5 years ago
tangwei12	6a1db2044c	fix sync_with_distributed_lookup_table, test=develop (#19737) ... fix wrong place with distributed_lookup_table	5 years ago
123malin	a25a716e87	Optimize fleet API: add input check for some interfaces (#18971) ... * fleet api add input check, test=develop	6 years ago
Yi Liu	4ef6b8457a	adapte fleet api for localsgd and support nccl comm configuration in executor (#19443) ... test=develop	6 years ago
tangwei12	65c7368400	Fix the correctness of async mode at distributed training (#18863) ... * fix correctness of the communicator * fix a bug in send thread when sending var context is empty, test=develop * add lookup_table_prefetch_op and prefetch optimize, test=develop * remove remote prefetch GPU supported * word2vec force with CPU, test=develop * test dist remote lookup table force with CPU, test=develop	6 years ago
tangwei12	19dac67e9f	fix distribute transpiler GRPC error code 4, RPC Deadline (#18984) ... * fix sync mode hang in transpiler * remove sync mode in send/recv * replace PADDLE_ENFORCE with PADDLE_ENFORCE_NE	6 years ago
Tao Luo	2f8c7e021f	remove unused inference_transpiler unit-tests (#19130) ... * remove unused inference_transpiler unit-tests test=develop * remove InferenceTranspiler usage in quantize_transpiler.py test=develop	6 years ago
gongweibao	29d8781240	Polish fleet API to support cuda collective mode and nccl2 mode. (#18966) ... Polish fleet API to support cuda collective mode and nccl2 mode	6 years ago
Zeng Jinle	c194b0c835	Try to deprecate unstable python memory optimize (#18983) ... * deprecate python memory optimize, test=develop * remove memory_optimize in unittests, test=develop * add unittests to deprecated interfaces, test=develop	6 years ago
Zeng Jinle	8008ab4e6b	Remove legacy C++ memory optimization codes (#18834) ... * remove legacy memory optimization codes, test=develop * follow huihuang's comments,test=develop * follow luotao's comments, test=develop	6 years ago
Yi Liu	157211c4e1	supports distributed classification (#18690) ... * supports distributed classification training * update API.spec * fix evenly division in python3 * change "index_range" to "index_num" in shard_index operator test=document_preview test=develop	6 years ago
tangwei12	d845848341	do some odd jobs (#18641) ... do some odd jobs, test=develop	6 years ago
gongweibao	c0a82748cf	Polish backwards optimizer dependency codes and use more default values. (#18255)	6 years ago
Yi Liu	a873fa84ce	supports collective training with programs (#18392) ... 1. Since allreduce op has 4 reduce types, We split these four reduce types into four ops 2. We also refined the collective op code, e.g. we separated the collective op kernel into CPUKernel and CUDAKernel, and remove the device specified DeviceContext parameter in template as we already knew the target DeviceContext 3. We remove the newly added Collective op role to reduce the complexity of program and graph analysis	6 years ago
HaoRen	b7128bac5f	supports collective communicated training (#18175) ... * fix prepare context redundant code problem, optimize executor by caching create_varaiables test=develop * supports collective training in executor * make fetch_list runable with variables, add more unittest for use_program_cache test=develop * fix comment test=develop * use unique name for nccl_id * supports output to stream in program_to_code * insert sync_comm_stream before regularization; add skip_op_callstack capability in program_to_code * set op role in collective training * add collective op role * remove orig file * add build optimizer by strategy * add collective strategy * refine collective strategy * add multi-process role maker * refine strategy building factory so that we can easily plugin more strategy * scale loss grad in collective sgd transpiler * add support for distributed fc * code format * revert some features for dist fc * add support for distributed fc training * fix prepare context redundant code problem, optimize executor by caching create_varaiables test=develop * supports collective training in executor * make fetch_list runable with variables, add more unittest for use_program_cache test=develop * use unique name for nccl_id * supports output to stream in program_to_code * insert sync_comm_stream before regularization; add skip_op_callstack capability in program_to_code * set op role in collective training * add collective op role * fix comment test=develop * remove orig file * add build optimizer by strategy * add collective strategy * refine collective strategy * add multi-process role maker * refine strategy building factory so that we can easily plugin more strategy * scale loss grad in collective sgd transpiler * add support for distributed fc * code format * revert some features for dist fc * add support for distributed fc training * test=develop add collective op unittest standard * test=develop remove the test_collective directory * test=develop remove the test_collective directory * remove slicegather test * code format for reducescatter * update attr of shard_index_op * Modify macro nccl_helper * remove test without distribute * macro collective_helper * marcro update * test=develop update support python3.5 * test=develop change gpu memory use to 0.1 when test * test=develop update ut equal func * test=develop set flags to 1.5 * test=develop fix pickle dumple py35 * test=develop fix divide in slice and add sync_comm_stream update atol and rtol to 1e-05 rm shard_index op and test modify read input from file to read from memory remove origin_program in framework and add i/o in c_sync_calc_stream * test=develop update unittest sync operator I/O	6 years ago
chengduo	e06c69c788	Fix default value of fluid.memory_optimize (#18295) ... * fix default value of fluid.memory_optimize test=develop * fix api.spec test=develop	6 years ago
tangwei12	659b72a97c	fix document of python api get_startup_program() (#17764) ... * add example to get_startup_program() * fix example to get_startup_program()	6 years ago
yaoxuefeng	ac92e4c066	fix distributed_transpiler.py api test=develop (#17668)	6 years ago
gongweibao	0d561ef442	fix 2dconn test=develop (#17681)	6 years ago
tangwei12	0d3c48e0a8	fix doc in transpiler, test=develop (#17313) ... * fix doc in transpiler, test=develop	6 years ago
gongweibao	65bbf950ee	Add multi-ncclcomm and 2D ncclallreduce support. (#17263)	6 years ago
Michał Gallus	0c39b97b4e	[MKL-DNN] Add Fully Connected Op for inference only(#15226) ... * fuse mul and elementwise add to fc * Reimplement the FC forward operator * Fix FC MKLDNN integration by transposing weights * Add FC MKLDNN Pass test=develop * FC MKLDNN Pass: change memcpy to std::copy * Fix MKLDNN FC handling of mismatch input and weights dims * Lower tolerance for MKL-DNN in resnet50 test test=develop * Adjust FC to support MKLDNN Op placement test=develop * Adjust Placement Op to set use_mkldnn attribute for graph test=develop * MKLDNN FC: fix weights format so that gemm version is called test=develop * FC MKLDNN: Remove tolerance decrease from tester_helper * FC MKL-DNN: Refactor the code, change input reorder to weight reorder * MKL-DNN FC: Introduce operator caching test=develop * FC MKL-DNN: Fix the tensor type in ExpectedKernelType test=develop * FC MKL-DNN: fix style changes test=develop * FC MKL-DNN: fallback to native on non-supported dim sizes test=develop * FC MKLDNN: fix CMake paths test=develop * FC MKLDNN: Refine placement pass graph mkldnn attribute test=develop * Fix Transpiler error for fuse_conv_eltwise test=develop * Fix missing STL includes in files test=develop * FC MKL-DNN: Enable new output size computation Also, refine pass to comply with newest interface. test=develop * FC MKL-DNN: enable only when fc_mkldnn_pass is enabled * FC MKL-DNN: Allow Weights to use oi or io format * FC MKL-DNN: Adjust UT to work with correct dims test=develop * Enable MKL DEBUG for resnet50 analyzer test=develop * FC MKL-DNN: Improve Hashing function test=develop * FC MKL-DNN: Fix shape for fc weights in transpiler * FC MKL-DNN: Update input pointer in re-used fc primitive * Add log for not handling fc fuse for unsupported dims test=develop * FC MKL-DNN: Move transpose from pass to Op Kernel test=develop * FC MKL-DNN: Disable transpose in unit test test=develop * FC MKL-DNN: Remove fc_mkldnn_pass from default list * Correct Flag for fake data analyzer tests test=develop * FC MKL-DNN: Add comment about fc mkldnn pass disablement test=develop * FC MKL-DNN: Disable fc in int8 tests test=develop	6 years ago
Qiao Longfei	92e7d5d7cc	fix distribute doc test=develop (#17318) ... * fix distribute doc	6 years ago
Qiao Longfei	58f7695ab2	Async exe support communicator (#17386) ... Async exe support communicator	6 years ago
liuwei1031	f82e4d75e7	improve the doc of paddle.fluid.memory_optimize, test=develop (#17473) ... * improve the doc of paddle.fluid.memory_optimize, test=develop * fix typo, test=develop	6 years ago
liuwei1031	6a53fa95e7	improve the API Sample of DataFeeder, memory_optimize and release_memory (#17374) ... * improve the API Sample of DataFeeder, memory_optimize and release_memory, test=develop * update API.spec, test=develop, test=document_preview * tweak the code format of feed API, test=develop * update API.spec, test=develop * improve doc for DataFeeder and default_main_program, test=develop	6 years ago
tangwei12	7330cd639c	truncated_gaussian_random supported in distributed training, test=develop (#17091)	6 years ago
tangwei12	1a4a51db2b	Fleet unify distributed training (#16791) ... * implement distributed transpiler with fleet	6 years ago
Qiao Longfei	0608f8ca56	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into add-async_sparse_param_update_recorder	6 years ago
Qiao Longfei	d640c6cfa9	fix pylint	6 years ago
Qiao Longfei	542b52fac3	fix trainer_id	6 years ago
Qiao Longfei	de65398cb8	update transpiler and listen and serv op	6 years ago
Qiao Longfei	fab1b54d99	Merge branch 'add-communicator' of ssh://github.com/jacquesqiao/Paddle into add-async-ssa-graph-executor-communicator	6 years ago
Xin Pan	0c277ac6e9	polish ... test=develop	6 years ago
Xin Pan	840cf780e4	add deprecation warning. ... test=develop	6 years ago
Qiao Longfei	b8491bfd4e	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into add-communicator	6 years ago
tangwei12	971f3bc9b0	fix params with only 1 dim (#15828) ... * fix params with only 1 dim * test=develop	6 years ago
dzhwinter	84f067be94	update. test=develop ... test=develop	6 years ago
dzhwinter	d453b0dcf7	add details. test=develop	6 years ago
Qiao Longfei	8bda4ab213	parameter recv can run	6 years ago
Qiao Longfei	fbd186bd5d	complete recv op	6 years ago
Qiao Longfei	4356f186b4	complete parameter_send	6 years ago
dzhwinter	9c9ad7d40b	Merge remote-tracking branch 'origin/develop' into feature/ir_inplace_pass ... test=develop	6 years ago
dzhwinter	0a63234c85	follow comments. test=develop	6 years ago