You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

HaoRen b7128bac5f supports collective communicated training (#18175) ... * fix prepare context redundant code problem, optimize executor by caching create_varaiables test=develop * supports collective training in executor * make fetch_list runable with variables, add more unittest for use_program_cache test=develop * fix comment test=develop * use unique name for nccl_id * supports output to stream in program_to_code * insert sync_comm_stream before regularization; add skip_op_callstack capability in program_to_code * set op role in collective training * add collective op role * remove orig file * add build optimizer by strategy * add collective strategy * refine collective strategy * add multi-process role maker * refine strategy building factory so that we can easily plugin more strategy * scale loss grad in collective sgd transpiler * add support for distributed fc * code format * revert some features for dist fc * add support for distributed fc training * fix prepare context redundant code problem, optimize executor by caching create_varaiables test=develop * supports collective training in executor * make fetch_list runable with variables, add more unittest for use_program_cache test=develop * use unique name for nccl_id * supports output to stream in program_to_code * insert sync_comm_stream before regularization; add skip_op_callstack capability in program_to_code * set op role in collective training * add collective op role * fix comment test=develop * remove orig file * add build optimizer by strategy * add collective strategy * refine collective strategy * add multi-process role maker * refine strategy building factory so that we can easily plugin more strategy * scale loss grad in collective sgd transpiler * add support for distributed fc * code format * revert some features for dist fc * add support for distributed fc training * test=develop add collective op unittest standard * test=develop remove the test_collective directory * test=develop remove the test_collective directory * remove slicegather test * code format for reducescatter * update attr of shard_index_op * Modify macro nccl_helper * remove test without distribute * macro collective_helper * marcro update * test=develop update support python3.5 * test=develop change gpu memory use to 0.1 when test * test=develop update ut equal func * test=develop set flags to 1.5 * test=develop fix pickle dumple py35 * test=develop fix divide in slice and add sync_comm_stream update atol and rtol to 1e-05 rm shard_index op and test modify read input from file to read from memory remove origin_program in framework and add i/o in c_sync_calc_stream * test=develop update unittest sync operator I/O		6 years ago
..
CMakeLists.txt	supports collective communicated training (#18175)	6 years ago
allreduce_op.cc	ParallelDyGraph with GPU collective mode (#16827)	6 years ago
allreduce_op.cu.cc	ParallelDyGraph with GPU collective mode (#16827)	6 years ago
allreduce_op.h	polish parallel dygraph code (#17164)	6 years ago
broadcast_op.cc	Add broadcast operators (#17503)	6 years ago
broadcast_op.cu.cc	Add broadcast operators (#17503)	6 years ago
checkpoint_notify_op.cc	Refactor distributed RPC (#15075)	6 years ago
fake_init_op.cc	Polish code style	6 years ago
fetch_barrier_op.cc	Refactor distributed RPC (#15075)	6 years ago
gen_nccl_id_op.cc	fix 2dconn test=develop (#17681)	6 years ago
listen_and_serv_op.cc	update transpiler and listen and serv op	6 years ago
listen_and_serv_op.h	fix cpplint test=develop	6 years ago
merge_ids_op.cc	Polish code style	6 years ago
merge_ids_op.h	fix bug in merge_ids (#15503)	6 years ago
prefetch_op.cc	Refactor distributed RPC (#15075)	6 years ago
recv_op.cc	Async exe support communicator (#17386)	6 years ago
ref_by_trainer_id_op.cc	Fix distribute compile	6 years ago
ref_by_trainer_id_op.cu.cc	Refine operator cmake (#14413)	6 years ago
ref_by_trainer_id_op.h	Refine operator cmake (#14413)	6 years ago
send_barrier_op.cc	Refactor distributed RPC (#15075)	6 years ago
send_op.cc	fix compile test=develop	6 years ago
send_recv_op_test.cc	Revert the changes of VLOG	6 years ago
send_recv_util.h	add some check	6 years ago
split_byref_op.cc	fix split_byref_op infer shape	6 years ago
split_byref_op.cu.cc	Refine operator cmake (#14413)	6 years ago
split_byref_op.h	Revert the changes of VLOG	6 years ago
split_ids_op.cc	Polish code style	6 years ago
split_ids_op.h	rewrite variable type	6 years ago
test_send_nccl_id.cc	Refactor distributed RPC (#15075)	6 years ago