9 Commits (9881738e130e907620c06f877763428f133672dc)

Author	SHA1	Message	Date
danleifeng	389a9a7e0e	fix ports conflict when use paddlecloud to launch analogue multi-nodes (#26191) ... * fix ports conflict when launching multi-nodes in paddlecloud;test=develop * add DISTRIBUTED_TRAINER_ENDPOINTS env for cloud;test=develop	5 years ago
Chen Weihang	31f422ae5e	Add interface to launch parallel dygraph by multiprocessing (#26044) ... * add dygraph parallel run interface * polish implement & unified env property name * add print config arg * refactor init_parallel_env function * Compatible with multiprocessing and launch modes * set default trainer start port * support run in python 2 * polish python2 support code * remove python2 support * refine launch import * polish dome design details * refactor api implemention & path * use new method _set_expected_place * add spawn unittest framework & mnist test * add more unittests & doc * fix unittest failed * polish english doc * self review and polish details * refactor code by reviewer's comments * fix unittest failed * fix parallel_env unittest * fix several typos * fix error introduced when fixing typos * add unpublic note for start_processes * polish details by xiaoguang's comment * verify correctly when spawn nprocs=-1 * refactor spawn & init_parallel_env design * polish doc details * open spawn unittests * try to fix doc compile error * try to fix unknown doc format error * add skip unittest when not gpu	5 years ago
Yi Liu	f45f8363eb	records the offset of log when creating by paddle.distributed.launch (#25725) ... test=develop	5 years ago
gongweibao	80f1c50738	Fix typo in interface. (#24779)	5 years ago
Yi Liu	b0f18947f3	fix the compatibility of PY2 and PY3 in paddle.distributed.launch (#25304) ... * fix the compatibility of PY2 and PY3 in paddle.distributed.launch test=develop * only pull log of local rank 0 test=develop * log exception if UnicodeEncodeError occurs when pulling log in paddle.distributed.launch test=develop Co-authored-by: SunGaofeng <peakbee@gmail.com>	5 years ago
Yi Liu	5209b9a510	cat log to stdout when setting log_dir in launch (#25147) ... test=develop	5 years ago
mapingshuo	9388a6381c	fix popen error (#24767) ... replace join to terminate	6 years ago
Kaipeng Deng	80cf3c3c4d	Refine DataLoader support multi-processing (#23107) ... * add DataLoader, Dataset, BatchSampler	6 years ago
gongweibao	24a063f6ac	Add fleet checkpoint on local fs and remote fs(such as hdfs) for EDL (#22586)	6 years ago