Paddle

Commit Graph

Author	SHA1	Message	Date
Chen Weihang	31f422ae5e	Add interface to launch parallel dygraph by multiprocessing (#26044 ) * add dygraph parallel run interface * polish implement & unified env property name * add print config arg * refactor init_parallel_env function * Compatible with multiprocessing and launch modes * set default trainer start port * support run in python 2 * polish python2 support code * remove python2 support * refine launch import * polish dome design details * refactor api implemention & path * use new method _set_expected_place * add spawn unittest framework & mnist test * add more unittests & doc * fix unittest failed * polish english doc * self review and polish details * refactor code by reviewer's comments * fix unittest failed * fix parallel_env unittest * fix several typos * fix error introduced when fixing typos * add unpublic note for start_processes * polish details by xiaoguang's comment * verify correctly when spawn nprocs=-1 * refactor spawn & init_parallel_env design * polish doc details * open spawn unittests * try to fix doc compile error * try to fix unknown doc format error * add skip unittest when not gpu	5 years ago
Yi Liu	f45f8363eb	records the offset of log when creating by paddle.distributed.launch (#25725 ) test=develop	5 years ago
gongweibao	80f1c50738	Fix typo in interface. (#24779 )	5 years ago
Yi Liu	b0f18947f3	fix the compatibility of PY2 and PY3 in paddle.distributed.launch (#25304 ) * fix the compatibility of PY2 and PY3 in paddle.distributed.launch test=develop * only pull log of local rank 0 test=develop * log exception if UnicodeEncodeError occurs when pulling log in paddle.distributed.launch test=develop Co-authored-by: SunGaofeng <peakbee@gmail.com>	5 years ago
Yi Liu	5209b9a510	cat log to stdout when setting log_dir in launch (#25147 ) test=develop	5 years ago
mapingshuo	9388a6381c	fix popen error (#24767 ) replace join to terminate	5 years ago
Kaipeng Deng	80cf3c3c4d	Refine DataLoader support multi-processing (#23107 ) * add DataLoader, Dataset, BatchSampler	5 years ago
gongweibao	24a063f6ac	Add fleet checkpoint on local fs and remote fs(such as hdfs) for EDL (#22586 )	5 years ago

8 Commits (9aa39584feab51a8b92862fcef713477f88deaec)