Paddle

Commit Graph

Author	SHA1	Message	Date
tangwei12	caa90a6510	Integrated Trainer of Parameter Server (API add `fluid.contrib.layers.sparse_embedding` only) (#22957 ) * Integrated Trainer of Parameter Server	5 years ago
Chengmo	e85fcaa712	Fix fluid.embedding in Distributed Training (#25174 ) * test=develop, fix_embedding	5 years ago
ShenLiang	a6ab43aab4	add type for lsgd, test=develop (#24702 )	5 years ago
swtkiwi	f5c6dd6def	test=develop (#24522 )	5 years ago
Chen Weihang	25a233e46d	Simplify Program printing code to improve debugging efficiency (#23918 ) * add to_readable_code method, test=develop * polish doc details, test=develop * polish doc note, test=develop * fix unittest error, test=develop * fix coverage, test=develop * add print test, test=develop * add print param, test=develop * hidden to_readable_code api, test=develop * remove original tool methods, test=develop * remove old api using code, test=develop	5 years ago
tangwei12	853f2e5272	fix bug at sync with communicator (#23077 )	5 years ago
tianshuo78520a	433cef03e5	fix typo word (#22784 )	5 years ago
hutuxian	175954d894	PaddleBox Framework Part2 (#22466 ) * Add two types of Metric Calculator: MultiTaskCalculator & CmatchRankCalculator. * Add a config for DynamicAdjustChannelNum function to denote whether we will discard the remaining instances when they are not be distributed evenly. * Remove CPU code in Pull/PushSparse and we will add it back when testing it fully. * Fix some known issues: such as copying persistable vars after one epoch running.	5 years ago
tianshuo78520a	d2ba91aad1	fix typo words (#22653 )	5 years ago
tangwei12	66a3150135	SYNC with communicaotor (#22344 ) * add sync communicator and implement	5 years ago
tangwei12	948299aec8	deprecated for distribute transpiler api (#22513 ) * add deprecated for distribute transpiler, will delete it after 2.0.0, test=develop	5 years ago
tangwei12	82bc814a57	integrated HALF_ASYNC to communicator (#21869 ) * add half_async in the communicator * fix DistributedStrategy	5 years ago
123malin	985bceac53	Bug fix for sparse recorder (#21969 ) * test=develop, bug fix for sparse recorder	5 years ago
Chengmo	418abc92f4	Update pyramid related OP (#21372 ) * add special way to add distribute vars， Update Pyramid hash op	5 years ago
Chengmo	5c33919328	Fix grad clip (#21784 ) * fix grad clip， clip op belongs to Backward op when running in Parameter Server mode.	5 years ago
123malin	7fb817d447	add distributed_strategy (#21710 ) * add distributed_strategy	5 years ago
tangwei12	9ad940fdfe	memory leak for cpu (#21174 ) * add fake init for the trainer, fix large memory hold in the trainer * do not merge recv vars from a remote endpoint, test=develop * add recv and save op, merge slice var in one op, save memory * remove hsigmoid with pull sparse, test=develop	5 years ago
hutuxian	c5aec2fe68	Paddlebox Related to Framework (#21586 ) * Add a single_process_multi_thread transpiler. * Add some UTs. * Fix some API description.	5 years ago
Kaipeng Deng	ebfb720a63	add Adam beta1/beta2 support Variable (#21234 ) * add Adam beta1/beta2 support Variable. test=develop	5 years ago
123malin	20cdff0e02	Optimize decay (#20816 ) * update pserver decay blocks * update distributed notify handler	5 years ago
tangwei12	1d925440ca	fix fetch handler error with pslib (#20679 ) * fix fetch handler error with pslib * fix distributed lookup table op with 1 pserver	5 years ago
Chengmo	940c6ff1c8	Fix communicator slow bug & fix communicator stop bug (#20366 ) * test=develop,Fix communicator slow bug * test=develop, delete if() in stop_worker() * test=develop * fix UT, test=develop * fix bug in fetch handler, test=develop * fix bug in fetch handler, test=develop * test=develop, fix fetch barrier bug * test=develop, bug fix * test=develop, bug fix * test=develop, fix bug	5 years ago
123malin	b4a3b75002	bug fix: invalid learning rate decay in pserver async mode (#20325 ) * bug fix: invalid learning rate decay in pserver async mode	5 years ago
tangwei12	a010d883b4	doc fix, test=develop, test=document_fix (#20239 ) * doc fix, test=develop, test=document_fix	5 years ago
Chengmo	494d6cf252	Fix transpiler en doc (#20149 ) * test=develop,test=document_fix,fix transpiler doc,add API.spec	5 years ago
Chengmo	eb05db7104	Speed GEO-SGD (#20158 ) * delete debug vlog & add rpc function & fix word2vec bug & speed GEO-SGD	5 years ago
tangwei12	b5a410466c	Trainer heartbeat for async mode (#19600 ) Heartbeat for distributed async training.	5 years ago
Chengmo	728ec1b43d	Add GEO-SGD distribute training algorithm (#20018 ) * refector geo sgd & communicator	5 years ago
Zeng Jinle	5f2290ab84	Add deprecated memory optimize doc (#20111 ) * add deprecated memory optimize doc, test=develop, test=document_fix * merge develop to solve conflict, test=develop, test=document_fix	5 years ago
123malin	6c74e7387f	fix APIs, test=document_preview (#19954 ) * fix DistributeTranspilerConfig document, test=develop	5 years ago
tangwei12	6a1db2044c	fix sync_with_distributed_lookup_table, test=develop (#19737 ) fix wrong place with distributed_lookup_table	5 years ago
123malin	a25a716e87	Optimize fleet API: add input check for some interfaces (#18971 ) * fleet api add input check, test=develop	6 years ago
Yi Liu	4ef6b8457a	adapte fleet api for localsgd and support nccl comm configuration in executor (#19443 ) test=develop	6 years ago
tangwei12	65c7368400	Fix the correctness of async mode at distributed training (#18863 ) * fix correctness of the communicator * fix a bug in send thread when sending var context is empty, test=develop * add lookup_table_prefetch_op and prefetch optimize, test=develop * remove remote prefetch GPU supported * word2vec force with CPU, test=develop * test dist remote lookup table force with CPU, test=develop	6 years ago
tangwei12	19dac67e9f	fix distribute transpiler GRPC error code 4, RPC Deadline (#18984 ) * fix sync mode hang in transpiler * remove sync mode in send/recv * replace PADDLE_ENFORCE with PADDLE_ENFORCE_NE	6 years ago
Tao Luo	2f8c7e021f	remove unused inference_transpiler unit-tests (#19130 ) * remove unused inference_transpiler unit-tests test=develop * remove InferenceTranspiler usage in quantize_transpiler.py test=develop	6 years ago
gongweibao	29d8781240	Polish fleet API to support cuda collective mode and nccl2 mode. (#18966 ) Polish fleet API to support cuda collective mode and nccl2 mode	6 years ago
Zeng Jinle	c194b0c835	Try to deprecate unstable python memory optimize (#18983 ) * deprecate python memory optimize, test=develop * remove memory_optimize in unittests, test=develop * add unittests to deprecated interfaces, test=develop	6 years ago
Zeng Jinle	8008ab4e6b	Remove legacy C++ memory optimization codes (#18834 ) * remove legacy memory optimization codes, test=develop * follow huihuang's comments,test=develop * follow luotao's comments, test=develop	6 years ago
Yi Liu	157211c4e1	supports distributed classification (#18690 ) * supports distributed classification training * update API.spec * fix evenly division in python3 * change "index_range" to "index_num" in shard_index operator test=document_preview test=develop	6 years ago
tangwei12	d845848341	do some odd jobs (#18641 ) do some odd jobs, test=develop	6 years ago
gongweibao	c0a82748cf	Polish backwards optimizer dependency codes and use more default values. (#18255 )	6 years ago
Yi Liu	a873fa84ce	supports collective training with programs (#18392 ) 1. Since allreduce op has 4 reduce types, We split these four reduce types into four ops 2. We also refined the collective op code, e.g. we separated the collective op kernel into CPUKernel and CUDAKernel, and remove the device specified DeviceContext parameter in template as we already knew the target DeviceContext 3. We remove the newly added Collective op role to reduce the complexity of program and graph analysis	6 years ago
HaoRen	b7128bac5f	supports collective communicated training (#18175 ) * fix prepare context redundant code problem, optimize executor by caching create_varaiables test=develop * supports collective training in executor * make fetch_list runable with variables, add more unittest for use_program_cache test=develop * fix comment test=develop * use unique name for nccl_id * supports output to stream in program_to_code * insert sync_comm_stream before regularization; add skip_op_callstack capability in program_to_code * set op role in collective training * add collective op role * remove orig file * add build optimizer by strategy * add collective strategy * refine collective strategy * add multi-process role maker * refine strategy building factory so that we can easily plugin more strategy * scale loss grad in collective sgd transpiler * add support for distributed fc * code format * revert some features for dist fc * add support for distributed fc training * fix prepare context redundant code problem, optimize executor by caching create_varaiables test=develop * supports collective training in executor * make fetch_list runable with variables, add more unittest for use_program_cache test=develop * use unique name for nccl_id * supports output to stream in program_to_code * insert sync_comm_stream before regularization; add skip_op_callstack capability in program_to_code * set op role in collective training * add collective op role * fix comment test=develop * remove orig file * add build optimizer by strategy * add collective strategy * refine collective strategy * add multi-process role maker * refine strategy building factory so that we can easily plugin more strategy * scale loss grad in collective sgd transpiler * add support for distributed fc * code format * revert some features for dist fc * add support for distributed fc training * test=develop add collective op unittest standard * test=develop remove the test_collective directory * test=develop remove the test_collective directory * remove slicegather test * code format for reducescatter * update attr of shard_index_op * Modify macro nccl_helper * remove test without distribute * macro collective_helper * marcro update * test=develop update support python3.5 * test=develop change gpu memory use to 0.1 when test * test=develop update ut equal func * test=develop set flags to 1.5 * test=develop fix pickle dumple py35 * test=develop fix divide in slice and add sync_comm_stream update atol and rtol to 1e-05 rm shard_index op and test modify read input from file to read from memory remove origin_program in framework and add i/o in c_sync_calc_stream * test=develop update unittest sync operator I/O	6 years ago
chengduo	e06c69c788	Fix default value of fluid.memory_optimize (#18295 ) * fix default value of fluid.memory_optimize test=develop * fix api.spec test=develop	6 years ago
tangwei12	659b72a97c	fix document of python api get_startup_program() (#17764 ) * add example to get_startup_program() * fix example to get_startup_program()	6 years ago
yaoxuefeng	ac92e4c066	fix distributed_transpiler.py api test=develop (#17668 )	6 years ago
gongweibao	0d561ef442	fix 2dconn test=develop (#17681 )	6 years ago
tangwei12	0d3c48e0a8	fix doc in transpiler, test=develop (#17313 ) * fix doc in transpiler, test=develop	6 years ago
gongweibao	65bbf950ee	Add multi-ncclcomm and 2D ncclallreduce support. (#17263 )	6 years ago

1 2 3 4 5 ...

367 Commits (0e101c4f6fd4f2d038d725ecae5729d904ef694e)