29 Commits (5631fc0817cb44aeff29478baad45d189901b484)

Author	SHA1	Message	Date
Wu Yi	856f0da0fe	Fp16 training (#14992) ... * wip * wip * wip * wip for test * add fp16 tests test=develop * fix cpu build test=develop * fix test=develop * fix py3 tests test=develop * fix lr_scheduler dtype test=develop * fix test=dvelop * test fix ci compile test=develop * fix build and merge test=develop * fallback momentumop change to general test=develop * make fp16 lr schedule simple test=develop * fix ut test=develop * fix tests test=develop * remove fp16 learning rate cast test=develop	6 years ago
typhoonzero	da87f7a698	Revert "[Feature] Fp16 training for resnet50 (#14850)" ... This reverts commit 3d750f9c5a.	6 years ago
Wu Yi	3d750f9c5a	[Feature] Fp16 training for resnet50 (#14850) ... * wip * wip * wip * wip for test * add fp16 tests test=develop * fix cpu build test=develop * fix test=develop * fix py3 tests test=develop * fix lr_scheduler dtype test=develop * fix test=dvelop * test fix ci compile test=develop * fix build and merge test=develop * fallback momentumop change to general test=develop	6 years ago
Yu Yang	9bd70a1e04	Change tensor uses proto::VarType::type ... test=develop	7 years ago
Wu Yi	29d9fb53fc	[Feature] multi process multi gpu dist training, boost v100 performance by 20% (#14661) ... * wip multi process multi gpu dist training * workable for p2p * update test=develop * change back env name test=develop * fix alloc init * fix cpu build test=devlop * fix mac tests test=develop * refine code * refine test=develop	7 years ago
minqiyang	53433d7f2e	Revert the changes of VLOG ... test=develop	7 years ago
peizhilin	7840d181c9	fix style issue	7 years ago
peizhilin	ca60e1d34d	Merge remote-tracking branch 'upstream/develop' into windows/build	7 years ago
minqiyang	0c3227a523	Change the origin VLOG level to 10 times ... Fix code to support cpplint syntax check test=develop	7 years ago
peizhilin	9d67c1fb69	cpu build support	7 years ago
Wu Yi	f90c7865f0	Benchmark tool for imgnet (#12305) ... * support test using executor without reader * run imgnet * update fluid benchmark * wip * update * update all models * support pyreader * update * clean up * make profile batches contollable * update API.spec * update scripts * clean dockerfile * update * clean comments * add scope argument docstring * use num_trainers to determine nccl init comms	7 years ago
Qiyang Min	046bb5c8cb	Fix NCCLBcast hang up bug in Parallel Executor (#11377) ... * 1. Create buddy allocator in each places before NcclBcast the variables 2. Check the memory usage of ALL gpus rather than the first one * 1. Make NCCLGroupGuard guards only the ncclBcast part, which avoid ncclGroupEnd blocking the exception throwing 2. NOTE the usage of NCCLGroupGuard * Remove the memory usage check of gpus * Fix code style	7 years ago
gongweibao	4fb7cc7f5e	Move sync_mode device ctx from grpc server (#10881)	7 years ago
yuyang18	7c777dd549	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into feature/exec_strategy	7 years ago
yuyang18	08295f9877	Add build strategy	7 years ago
typhoonzero	7b0c0273f4	update by comments	7 years ago
typhoonzero	f5840d8925	follow comments	7 years ago
typhoonzero	17009d0627	workable version	7 years ago
typhoonzero	3667578ec2	testing	7 years ago
typhoonzero	d9320dcd94	complete code	7 years ago
Yu Yang	093d227a77	Use mutex to stablize ncclCtxMap	7 years ago
Yu Yang	c64190ecbb	Polish NCCLHelper	7 years ago
qingqing01	129859e732	Support data type int64 in NCCL. (#9818)	7 years ago
Yu Yang	7dcb217e31	Refine allreduce op	7 years ago
Yu Yang	c0c2e15920	NCCL AllReduce	7 years ago
Yu Yang	fe7ed285d1	Extract NCCLCtxMap	7 years ago
Yu Yang	6ebc6bf533	ReorganizeCode	7 years ago
Yu Yang	41ad632341	Add NCCL Group Guard	7 years ago
Yu Yang	99fe83a020	Move nccl helper	7 years ago