110 Commits (8c19d7aa2f89a38b3a68e53c73d88af16a3de8ce)

Author	SHA1	Message	Date
Qi Li	9b016c7cb7	[ROCM] update fluid operators for rocm (part2), test=develop (#31211)	4 years ago
WangXi	467c716963	gen nccl id use socket (#29431)	4 years ago
tangwei12	202bfab1be	Feature/large scale kv save base/delta (#27470) ... * add size method for large scale * add large scale UT * add ut for checkpoint	4 years ago
Chengmo	328cb289ed	【paddle.fleet】fix sparse load (#27680) ... * add sparse tensor load method	4 years ago
tangwei12	cf70d5b350	fix paddle error informations (#27889)	4 years ago
zhang wenhui	7a58431c0a	fix norm api doc, test=develop (#27652) ... * fix norm api doc, test=develop * fix error message, test=develop * fix api norm, test=develop * add adagrad, test=develop * fix bug, test=develop * fix bug, test=develop * add spetral_norm, test=develop * fix adagrad, test=develop * merge , test=develop	4 years ago
tangwei12	9704582eef	fix op error (#27599) ... * fix error * fix error * fix error * merge develop	4 years ago
yaoxuefeng	c9a8801325	enhance error messages of lookup_tale, merge_ids, data_norm (#27619) ... * enhance error messages of lookup_tale, merge_ids, data_norm * fix * fix error msg in .cu	4 years ago
wanghuancoder	df43905f12	use iwyu clean include (#27267) ... * use iwyu clean include, test=develop, test=win * compilation error, test=develop * fix compilation error2, test=develop * fix compilation error3, test=develop * fix compilation error4, test=develop * fix compilation error5, test=develop * fix compilation error6, test=develop * fix compilation error7, test=develop * fix compilation error8, test=develop * fix compilation error8, test=develop * fix compilation error10, test=develop * fix compilation error11, test=develop	4 years ago
tangwei12	bc5f0246a8	large scale kv speedup (#26510) ... * rename communicator meet->BatchesCounter * fix parame recv for sparse * geo sparse init from pserver * optimize init from pserver * add large scale optimizer fuse(SGD/ADAM) * rectification init_worker and exe.run startup program	4 years ago
Chen Weihang	41b5955538	Polish no onwer ops error message (#27448) ... * polish no onwer op error message * fix unittest failed * polish details based reviewer comment	4 years ago
Yi Liu	e9a0fbfff2	OP报错信息优化 (#27301) ... paddle/fluid/operators/distributed_ops OP报错信息优化	4 years ago
ShenLiang	c296618c94	fix error message in broadcast/allreduce/gather (#27302) ... * fix error message	4 years ago
Chengmo	d0962abd20	supplement bug fix of parameter server (#26217) ... * fix fluid.embedding	5 years ago
Chengmo	7f2aa2db3c	【paddle.fleet】Support Heter Parameter Server (#25998) ... * Support Heter Parameter Server	5 years ago
Chengmo	eeeef957c7	Fix ps gpu (#26218) ... * support ps-gpu	5 years ago
tangwei12	caa90a6510	Integrated Trainer of Parameter Server (API add `fluid.contrib.layers.sparse_embedding` only) (#22957) ... * Integrated Trainer of Parameter Server	5 years ago
tangwei12	4b3778a3ee	Revert/barrier for sync (#25417) ... * add retry for prefetch * Revert "Fix/sync barrier (#25016)" This reverts commit be6a315fbd. * reopen dist UT, test=develop * remove fl UT, test=develop	5 years ago
Chengmo	e85fcaa712	Fix fluid.embedding in Distributed Training (#25174) ... * test=develop, fix_embedding	5 years ago
tangwei12	be6a315fbd	Fix/sync barrier (#25016) ... * fix sync barrier with barrier monitor, test=develop	5 years ago
Chen Weihang	d1062d5278	Replace all errors thrown by LOG(FATAL) with PADDLE_THROW (#24759) ... * remove REPLACE_ENFORCE_GLOG compile option & add ci rule prohibit LOG(FATAL) using, test=develop * remove ci test case, test=develop * replace all LOG(FATAL) & polish message, test=develop * fix typo, test=develop * polish error info detail, test=develop	5 years ago
Yi Liu	12bffdc086	Enhance error message of checkpoint_notify_op, fake_init_op gen_nccl_id_op and listen_and_serv_op (#24554) ... test=develop	5 years ago
yaoxuefeng	16817c70fc	OP(datanorm lookupsparsetable lookuptable) error message enhancement (#24506) ... * OP(datanorm lookupsparsetable lookuptable) error message enhancement * fix test=develop * fix test=develop * fix test=develop * fix test=develop * fix test=develop * fix test=develop * fix test=develop	5 years ago
ShenLiang	53e3c53423	fix error message, test=develop (#24425)	5 years ago
gongweibao	f1c57d648c	Enhance error message of prefetch_op, proximal_adagrad_op, proximal_gd_op (#24436)	5 years ago
tangwei12	a97d5a6153	fix op error, test=develop (#24451)	5 years ago
Chen Weihang	aa0f254fbe	Add macro BOOST_GET to enrich the error information of boost :: get (#24175) ... * add new macro BOOST_GET_SAFELY & unittests, test=develop * add different macro type, test=develop * fix get macro type in executor, test=develop * four macro part change backup * using one macro for all case, test=develop * revert attribute change, test=develop * change to three func to solve gcc4.8 bug, test=develop * polish some details, test=develop	5 years ago
liuwei1031	9a93f6aae0	improve efficiency of runtime InferVarType (#22778) ... * save InferVarType changes, test=develop * remove code comments, test=develop * tweak code, test=develop * fix compilation warning, update merge_ids_op split_ids_op to new interface, test=develop * modify fused_bn_activation_op, test=develop * fix error of fused_bn_activation_op, test=develop * fix PADDLE_ENFORCE and unittest coverage issue, test=develop * tweak PADDLE_ENFORCE messages, test=develop * improve unittest coverage, test=develop * add StaticGraphInferVarType class, test=develop * rebase develop branch, test=develop * fix unittest error, test=develop * remove comments, test=develop * improve unittest coverage, test=develop * imporve error message and imporve unittest coverage, test=develop * upgrade InferVarType API, test=develop * tweak pyfunc error message, test=develop * fix compilation conflict - save_combine_op, test=develop	5 years ago
tianshuo78520a	433cef03e5	fix typo word (#22784)	5 years ago
guofei	ae8b5f11a3	Change ShareDataWith() to TensorCopy() in ref_by_trainer_id (#22717) ... As the title	5 years ago
tangwei12	66a3150135	SYNC with communicaotor (#22344) ... * add sync communicator and implement	5 years ago
Wilber	de009152a7	Compile without nccl deps. [2/2] (#22484) ... Compile without nccl deps. [1/2] Co-authored-by: 石晓伟 <39303645+Shixiaowei02@users.noreply.github.com>	5 years ago
Wilber	7bc4b09500	add WITH_NCCL option for cmake. (#22384) ... cmake选项中添加了WITH_NCCL，显示指定是否编译NCCL的部分代码，WITH_NCCL默认打开，但如果WITH_GPU为OFF，则关闭WITH_NCCL 添加了PADDLE_WITH_NCCL定义 单机单卡能够关闭NCCL编译，多卡的话需要默认打开NCCL，如果关闭NCCL，则只能使用单卡 Co-authored-by: 石晓伟 <39303645+Shixiaowei02@users.noreply.github.com>	5 years ago
tangwei12	82bc814a57	integrated HALF_ASYNC to communicator (#21869) ... * add half_async in the communicator * fix DistributedStrategy	5 years ago
zhangchunle	805328e13b	fix typo in error message (#22312)	5 years ago
123malin	985bceac53	Bug fix for sparse recorder (#21969) ... * test=develop, bug fix for sparse recorder	5 years ago
123malin	7fb817d447	add distributed_strategy (#21710) ... * add distributed_strategy	5 years ago
zhouwei25	a01663ca1f	remove patch command and file of cares to Improved quality of Paddle Repo (#21776)	5 years ago
Chen Weihang	1fd1f06f11	Rename paddle throw error macro (#21657) ... * rename paddle throw error macro, test=develop * fix new error use case, test=develop	5 years ago
tangwei12	9ad940fdfe	memory leak for cpu (#21174) ... * add fake init for the trainer, fix large memory hold in the trainer * do not merge recv vars from a remote endpoint, test=develop * add recv and save op, merge slice var in one op, save memory * remove hsigmoid with pull sparse, test=develop	5 years ago
Tao Luo	70eb397677	remove unused snappy/snappystream depends in distributed codes (#21484) ... test=develop	5 years ago
tangwei12	0bddb951c2	fix async mode, test=develop (#21367)	5 years ago
hong	ac8546701d	Add dygraph execution context (#20157) ... * add_dygraph_execution_context * add dygraph infershape context and execution context; test=develop * fix imperative bug; test=develop * remove inputs outputs interface from execution context, because it have same function with inputNames; test=develop * remove tracer_test ctest; test=develop * fix split op bug; test=develop * fix unitests bug; test=develop * fix distribute test bug; test=develop * fix ngraph compile bug; test=develop * fix grad maker bug; test=develop * fix load op bugs; test=develop * fix operator.cc construct bug; test=develop * remove useless name find in operator; test=develop * add tracer_test; test=develop * fix concat, split bug; test=develop * remove tracer_test unitest; test=develop * fix attribute check bug; test=develop * add test code to fix converage; test=develop * remove useless code, change check backward input in engin; test=develop * unlock var type infer shape;test=develop * add ShareAllLoD api; test=develop * add dygraph infershape context unitest; test=develop * remove increase and decrease lod in dygraph; test=develop * addd override; test=develop * fix increase descrease lod; test=develop * fix paddle_enforce; test=develop * disable lod op dygraph check; test=develop * fix paddle enforce error; test=develop * add comment for op_registry and OperatorBase; test=develop * optimize the comment of op_registry; test=develop * fix format of comment; test=develop * fix format of comment; test=develop * optimize the format of comment; test=develop * optimize the format of the comment; test=develop * optimize comment of op_registry; test=develop	5 years ago
123malin	20cdff0e02	Optimize decay (#20816) ... * update pserver decay blocks * update distributed notify handler	5 years ago
hong	8c4573a3cb	GradMaker for dygraph (#19706) ... * refactor dygraph,test=develop * fix failed unittest,test=develop * polish code,test=develop * check windows ci error,test=develop try to fix windows ci error by np.allclose,test=develop * polish vlog and profiler, test=develop * try to fix preceding ops order,test=develop * test transformer in windows ci, test=develop * use python c-api to speed up tracer.trace,test=develop * test=develop, fix docker with paddle nccl problem * test=develop, add ut for debug string and gradient_accumulator * test=develop, add tests for layer/gradient_accumulator/prepared_op * test=develop, fix complie error for test_prepared_op * test=develop, add more ut for dygraph * test=develop, create API.spec for dygraph api change * optimize grad maker; test=develop * optimize grad maker * test * grad make optim; test=develop * fix unittest bugs; test=develop * add dygraph grad op maker and split_op * grad op maker refactor; test=develop * add dygraph grad maker; test=develop * fix op deformable_conv_v1_op bug; test=develop * fix deformable_conv prroi pool bugs; * fix new op grad op maker bug; test=develop * fix split by ref bug; test=develop * fix dygraph auto prune bug; test=develop * fix test_trace bug; test=develop * fix fused emb seq pool bug; test=develop * remove useless code in op_desc file; test=develop * remove useless code, StrVarBaseNode; test=develop * fix review issues; test=develop * fix rank_loss grad maker; test=develop * remove flag in VarBase; test=develop * fix distributed_notify_op compile bug ; test=develop * fix reshape op double grad; test=develop * fix expand as op; test=develop * add impertive type_defs.h for demo_train; test=develop * fix inference lib cmake; test=develop * fix inference lib; test=develop * fix infernce_lib; test=develop * fix inference cmake; test=develop * fix inference lib; test=develop * fix inference lib; test=develop * remove condition dygraph grad maker, modify local name; test=develop * fix split grad maker bug; test=develop * fix pyramid_op bug; test=develop * change travis time out limit; test=develop * restore travis; test=develop * change timeout limit; test=develop	5 years ago
Chen Weihang	26cc1fe508	Replace risky GetInputType method with secure IndicateVarDataType interface (#20668) ... * replace part of the old implementation, test=develop * restore concat op, test=develop * update all ops implemention & delete GetDataTypeOfVar func, test=develop	5 years ago
Chengmo	940c6ff1c8	Fix communicator slow bug & fix communicator stop bug (#20366) ... * test=develop,Fix communicator slow bug * test=develop, delete if() in stop_worker() * test=develop * fix UT, test=develop * fix bug in fetch handler, test=develop * fix bug in fetch handler, test=develop * test=develop, fix fetch barrier bug * test=develop, bug fix * test=develop, bug fix * test=develop, fix bug	5 years ago
123malin	b4a3b75002	bug fix: invalid learning rate decay in pserver async mode (#20325) ... * bug fix: invalid learning rate decay in pserver async mode	5 years ago
tangwei12	b5a410466c	Trainer heartbeat for async mode (#19600) ... Heartbeat for distributed async training.	5 years ago
Chengmo	728ec1b43d	Add GEO-SGD distribute training algorithm (#20018) ... * refector geo sgd & communicator	5 years ago