Paddle

Commit Graph

Author	SHA1	Message	Date
tianshuo78520a	d2ba91aad1	fix typo words (#22653 )	5 years ago
tangwei12	d845848341	do some odd jobs (#18641 ) do some odd jobs, test=develop	6 years ago
HaoRen	b7128bac5f	supports collective communicated training (#18175 ) * fix prepare context redundant code problem, optimize executor by caching create_varaiables test=develop * supports collective training in executor * make fetch_list runable with variables, add more unittest for use_program_cache test=develop * fix comment test=develop * use unique name for nccl_id * supports output to stream in program_to_code * insert sync_comm_stream before regularization; add skip_op_callstack capability in program_to_code * set op role in collective training * add collective op role * remove orig file * add build optimizer by strategy * add collective strategy * refine collective strategy * add multi-process role maker * refine strategy building factory so that we can easily plugin more strategy * scale loss grad in collective sgd transpiler * add support for distributed fc * code format * revert some features for dist fc * add support for distributed fc training * fix prepare context redundant code problem, optimize executor by caching create_varaiables test=develop * supports collective training in executor * make fetch_list runable with variables, add more unittest for use_program_cache test=develop * use unique name for nccl_id * supports output to stream in program_to_code * insert sync_comm_stream before regularization; add skip_op_callstack capability in program_to_code * set op role in collective training * add collective op role * fix comment test=develop * remove orig file * add build optimizer by strategy * add collective strategy * refine collective strategy * add multi-process role maker * refine strategy building factory so that we can easily plugin more strategy * scale loss grad in collective sgd transpiler * add support for distributed fc * code format * revert some features for dist fc * add support for distributed fc training * test=develop add collective op unittest standard * test=develop remove the test_collective directory * test=develop remove the test_collective directory * remove slicegather test * code format for reducescatter * update attr of shard_index_op * Modify macro nccl_helper * remove test without distribute * macro collective_helper * marcro update * test=develop update support python3.5 * test=develop change gpu memory use to 0.1 when test * test=develop update ut equal func * test=develop set flags to 1.5 * test=develop fix pickle dumple py35 * test=develop fix divide in slice and add sync_comm_stream update atol and rtol to 1e-05 rm shard_index op and test modify read input from file to read from memory remove origin_program in framework and add i/o in c_sync_calc_stream * test=develop update unittest sync operator I/O	6 years ago
tangwei12	90df7ff378	transpiler.py code clean (#15555 ) * move var strusted to vars_distributed.py, add optimizer's block name, test=develop * rename optimzier's seems complex, revert it, test=develop * replace * with details, test=develop	6 years ago
gongweibao	fe8f28c957	Add GetVariableNoBarrier on brpc. (#15488 )	6 years ago
Qiao Longfei	fbc529db91	update test=develop	6 years ago
Qiao Longfei	98a0437d70	optimize distribute checkport test=develop	6 years ago
Wu Yi	16e73e0d28	hide operator API (#12543 ) * hide operator API * update * update api.spec * fix merge * fix test	6 years ago
Wu Yi	29c63d180f	[Feature] dist op role and lr op role, to support memory optimize with dist training (#13220 ) * wip * clean up * should fix running with memopt * add ut * mark lr schedule op role * hide lr_schedule_guard * use op_role_var instead of ufind * unify dist test name * wip for py3 support * fix var deref * fix python3 mem_opt order * remove comments	7 years ago
gongweibao	0c8c0d943f	fix macunittest (#13434 )	7 years ago
Wu Yi	3ab3a7f392	Trainer auto wait pserver ports (#13341 ) * trainer auto wait pserver port ready * add file * fix docstring * add option to not wait * update api spec * clean * fix test hang	7 years ago
minqiyang	c838fa3173	Port dist_transpiler to Python3.5 Resume prelu_op_test in python2	7 years ago
gongweibao	f9e20747fc	Modify program_to_desc functions to add types support. (#12991 )	7 years ago
minqiyang	a7849db561	Port new added code	7 years ago
gongweibao	7570e5ef04	Print readable program codes. (#12673 )	7 years ago
minqiyang	99d3f08920	Add print_function for all python files	7 years ago
minqiyang	6abe819f07	Fix pybind11 problem Fix str and bytes problem Fix sorted problem Fix math problem Fix CI problem	7 years ago
minqiyang	559d36328c	Apply 2to3 to current paddle main python code	7 years ago
Wu Yi	db67d60e31	Remove block api (#12107 ) * remove block api * remove clone_variable * hide block inner apis * update * fix tests	7 years ago
Wu Yi	d90610624f	Cleanup transpiler and move weight decay and clip on pservers (#11039 ) * WIP move weight decay * weight decay ok * wip * clean up transpiler * add details folder * update * fix split var test * follow comments	7 years ago

20 Commits (c5cbe7f07bb15b7a7f75baa6e64188b9e90a677e)