10 Commits (rocm_dev_0217)

Author	SHA1	Message	Date
Chen Weihang	8020e34e7c	Simplify the options of spawn based on fleetrun (#30144) ... * Simplify the options of spawn based on fleetrun * polish details * polish doc details	5 years ago
Chen Weihang	46c4695421	Set FLAGS_selected_gpus for spawn (#29962) ... * set flags_selectedd_gpus for spawn * add cond for unittest * Delete test_no_single_process_using_multi_gpus_in_spawn.py * Update spawn.py * Update nccl_context.cc	5 years ago
gongweibao	1358397e97	Clean up the redundant files and unify the launch interface. (#28928)	5 years ago
Chen Weihang	bb16c2515d	Polish parallel api impl & doc details (#28980) ... * polish parallel api impl & doc details * add unittest for coverage * remove spawn test in py2.7 * add parallel api into white list	5 years ago
Chen Weihang	ed31dac6eb	remove scale loss and coll grads, test=document_fix (#27874)	6 years ago
lilong12	bbc2add703	Initialize gloo for low level collective apis (#27672) ... * add gloo initializer, test=develop	6 years ago
lilong12	36c0410223	Revert "Initialize gloo for low level collective apis (#27356)", test=document_fix (#27665)	6 years ago
lilong12	fa73e4a284	Initialize gloo for low level collective apis (#27356) ... * add gloo initializer, test=develop	6 years ago
Chen Weihang	28cb653145	Remove backend argument of init_parallel_env (#26773) ... * remove backend argument of init_parallel_env * remove keep name table in transformer * add cpu version check * add skip unittest for init_parallel_env * polish doc: remove func use & update example	6 years ago
Chen Weihang	31f422ae5e	Add interface to launch parallel dygraph by multiprocessing (#26044) ... * add dygraph parallel run interface * polish implement & unified env property name * add print config arg * refactor init_parallel_env function * Compatible with multiprocessing and launch modes * set default trainer start port * support run in python 2 * polish python2 support code * remove python2 support * refine launch import * polish dome design details * refactor api implemention & path * use new method _set_expected_place * add spawn unittest framework & mnist test * add more unittests & doc * fix unittest failed * polish english doc * self review and polish details * refactor code by reviewer's comments * fix unittest failed * fix parallel_env unittest * fix several typos * fix error introduced when fixing typos * add unpublic note for start_processes * polish details by xiaoguang's comment * verify correctly when spawn nprocs=-1 * refactor spawn & init_parallel_env design * polish doc details * open spawn unittests * try to fix doc compile error * try to fix unknown doc format error * add skip unittest when not gpu	6 years ago