Tomasz Patejko
4a497b826d
MKLDNN implementation of batch normalization ( #9904 )
...
* Initial implementation of forward pass for MKLDNN batch norm
* Added attributes for MKLDNN batch norm
* MKLDNN batch norm forward pass passes unittest. Started working on backward
* Backward pass for MKLDNN batch norm added
* MKLDNN batch norm: scoring added to forward pass
* MKLDNN batch norm: bias as input added; handling AnyLayout when kernel is looked up
* MKLDNN batch norm: python unit tests added; mkldnn tests removed
* MKLDNN batch norm: changes required by cpplint
* MKLDNN batch norm: refactoring the operator
* MKLDNN batch norm: saved variance inversed in backward pass for correct execution of MKLDNN unit tests
* MKLDNN batch norm: refctoring, function for static/const cast to void* added
* MKLDNN batch norm: remove AnyLayout from batch norm
* MKLDNN batch norm: only NCHW format is supported. Unittests refactored
* MKDNN batch norm: use_mkldnn added to attributes
* MKLDNN batch norm: AnyLayout removed from unittest
* MKLDNN batch norm: added CUDNN defines to batch norm
* MKLDNN batch norm: undefined data_format variable corrected
* MKLDNN batch norm: use_cudnn added, use of setUp method for configuring attributes
* MKLDNN batch norm: added use_cudnn attribute to batch norm operator
* MKLDNN batch norm: correcting batch norm unit tests for MKLDNN
* MKLDNN batch norm: MKLDNN tests moved to another file; reverting changes for saved variance not being inverted
* Change default layout to NCHW
* MKLDNN batch norm: init_kernel_type method added to unit tests
* MKLDNN batch norm: style changes
* MKLDNN batch norm: unit tests refactored
* MKLDNN batch norm: added use_mkldnn attribute to batch norm python interface
7 years ago