|
|
|
@ -64,7 +64,7 @@ Input image size - 3 * 224 * 224, Time: images/second
|
|
|
|
|
| MKLML | 66.37 | 105.60 | 144.04 |
|
|
|
|
|
| MKL-DNN | 399.00 | 498.94 | 626.53 |
|
|
|
|
|
|
|
|
|
|
chart TBD
|
|
|
|
|
<img src="figs/alexnet-cpu-train.png" width="500">
|
|
|
|
|
|
|
|
|
|
#### Inference
|
|
|
|
|
Test on batch size 1, 2, 4, 8, 16 on Intel(R) Xeon(R) Gold 6148 CPU @ 2.40GHz
|
|
|
|
@ -76,6 +76,8 @@ Test on batch size 1, 2, 4, 8, 16 on Intel(R) Xeon(R) Gold 6148 CPU @ 2.40GHz
|
|
|
|
|
| MKLML | 5.58 | 9.80 | 15.15 | 21.21 | 28.67 |
|
|
|
|
|
| MKL-DNN | 75.07 | 88.64 | 82.58 | 92.29 | 96.75 |
|
|
|
|
|
|
|
|
|
|
<img src="figs/vgg-cpu-infer.png" width="500">
|
|
|
|
|
|
|
|
|
|
- ResNet-50
|
|
|
|
|
|
|
|
|
|
| BatchSize | 1 | 2 | 4 | 8 | 16 |
|
|
|
|
@ -84,6 +86,7 @@ Test on batch size 1, 2, 4, 8, 16 on Intel(R) Xeon(R) Gold 6148 CPU @ 2.40GHz
|
|
|
|
|
| MKLML | 6.33 | 12.02 | 22.88 | 40.53 | 63.09 |
|
|
|
|
|
| MKL-DNN | 107.83| 148.84 | 177.78 | 189.35 | 217.69 |
|
|
|
|
|
|
|
|
|
|
<img src="figs/resnet-cpu-infer.png" width="500">
|
|
|
|
|
|
|
|
|
|
- GoogLeNet
|
|
|
|
|
|
|
|
|
@ -93,6 +96,8 @@ Test on batch size 1, 2, 4, 8, 16 on Intel(R) Xeon(R) Gold 6148 CPU @ 2.40GHz
|
|
|
|
|
| MKLML | 22.74 | 41.56 | 81.22 | 133.47 | 210.53 |
|
|
|
|
|
| MKL-DNN | 175.10 | 272.92 | 450.70 | 512.00 | 600.94 |
|
|
|
|
|
|
|
|
|
|
<img src="figs/googlenet-cpu-infer.png" width="500">
|
|
|
|
|
|
|
|
|
|
- AlexNet
|
|
|
|
|
|
|
|
|
|
| BatchSize | 1 | 2 | 4 | 8 | 16 |
|
|
|
|
@ -101,7 +106,7 @@ Test on batch size 1, 2, 4, 8, 16 on Intel(R) Xeon(R) Gold 6148 CPU @ 2.40GHz
|
|
|
|
|
| MKLML | 21.32 | 36.55 | 73.06 | 131.15 | 192.77 |
|
|
|
|
|
| MKL-DNN | 442.91 | 656.41 | 719.10 | 847.68 | 850.51 |
|
|
|
|
|
|
|
|
|
|
chart TBD
|
|
|
|
|
<img src="figs/alexnet-cpu-infer.png" width="500">
|
|
|
|
|
|
|
|
|
|
### Laptop
|
|
|
|
|
TBD
|
|
|
|
|