11 Commits (d1e1d8588147e3d18e58d06e90017b1b7eb02952)

Author	SHA1	Message	Date
danleifeng	9171f73714	fix fp16 grid_size for size=1; test=develop (#20812)	5 years ago
danleifeng	425279a57b	Improve elementwise operators performance in same dimensions. (#19763) ... Improve elementwise operators performance in same dimensions	5 years ago
Leo Chen	982e61f5ff	Update elementwise double grad to save gpu memory (#19509) ... * update elementwise double grad to save gpu memory, test=develop * update elementwise_mul/div_grad_grad to save memory, test=develop * remove eval function in eigen statement to save memory, test=develop * add unittest for elementwise_div_grad_grad without dout, test=develop * add unittest for elementwise_add_grad_grad without ddx, test=develop * add float16 cuda kernel for elementwise double grad op, test=develop	6 years ago
Yiqun Liu	dcda20233c	Optimize the elementwise op using eigen (#15494) ... * Optimize the elementwise op with CUDA kernels. test=develop * Support setting of attr in op config file. test=develop * Add the support the setting dtype and initializer in config. test=develop * Save workspace. * Add initializer "zeros". test=develop * Fix compiling error. * Support the use of existed file to initailize tensor in op_tester. * Use eigen to optimize the elementwise_add/mul for the case that x and y have the same dims. test=develop	6 years ago
Kaipeng Deng	8bae8590ac	add double grad for elementwise_mul op (#17255) ... * add double grad for elementwise_mul. test=develop * remove comment. test=develop * fix grad sum. test=develop * fix for axis expand. test=develop * add test for axis expand. test=develop	6 years ago
zhaoyuchen2018	792443ef23	Refine elementwise kernel. (#16952) ... * Refine elementwise kernel. Add a simple cuda kernel if grad x and y both exist Use 2D block cuda kernel to do broadcast. test=develop Signed-off-by: zhaoyuchen <zhaoyuchen01@baidu.com> * refine code. test=develop Signed-off-by: zhaoyuchen <zhaoyuchen01@baidu.com> * refine code. test=develop Signed-off-by: zhaoyuchen <zhaoyuchen01@baidu.com>	6 years ago
Wu Yi	856f0da0fe	Fp16 training (#14992) ... * wip * wip * wip * wip for test * add fp16 tests test=develop * fix cpu build test=develop * fix test=develop * fix py3 tests test=develop * fix lr_scheduler dtype test=develop * fix test=dvelop * test fix ci compile test=develop * fix build and merge test=develop * fallback momentumop change to general test=develop * make fp16 lr schedule simple test=develop * fix ut test=develop * fix tests test=develop * remove fp16 learning rate cast test=develop	6 years ago
typhoonzero	da87f7a698	Revert "[Feature] Fp16 training for resnet50 (#14850)" ... This reverts commit 3d750f9c5a.	6 years ago
Wu Yi	3d750f9c5a	[Feature] Fp16 training for resnet50 (#14850) ... * wip * wip * wip * wip for test * add fp16 tests test=develop * fix cpu build test=develop * fix test=develop * fix py3 tests test=develop * fix lr_scheduler dtype test=develop * fix test=dvelop * test fix ci compile test=develop * fix build and merge test=develop * fallback momentumop change to general test=develop	6 years ago
Yu Yang	7604b1ad51	Fix Eigen macro when using GPU ... The macro should be defined by compiler rather than by source. test=develop	6 years ago
Wu Yi	a2d9b34417	Refine operator cmake (#14413) ... * wip simplify operator framework * wip * wip * done test=develop * clean test=develop * fix test=develop * fix deps test=develop * fix cpu build test=develop * fix tensorrt build test=develop * fix tests test=develop * fix test=develop * fix cpu build test=develop	6 years ago