You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Bob Zhu c670058a8d add support of matmul with multiple head even different width and height (#19708) ... * add support of matmul with multiple head even different width and height Original matmul with multiple head supports only the mat_a.width == mat_b.height, in that case, mat_b will be horizontally split. In this patch, we extend the support when mat_a.width != mat_b.height but mat_a.width/head_number == mat_b.height, in this case, mab_b will be vertically split. One example is A is [3, 8], B is [2, 16], head_number is 4. In this case, A will be split as [3, 2], B will be (vertically) split as [2, 4]. The final result will be 4 matrix of 4 matrix of [3,4], i.e. [3, 16] test=develop * add support of matmul with multiple head even different width and height Original matmul with multiple head supports only the mat_a.width == mat_b.height, in that case, mat_b will be horizontally split. In this patch, we extend the support when mat_a.width != mat_b.height but mat_a.width/head_number == mat_b.height, in this case, mab_b will be vertically split. One example is A is [3, 8], B is [2, 16], head_number is 4. In this case, A will be split as [3, 2], B will be (vertically) split as [2, 4]. The final result will be 4 matrix of 4 matrix of [3,4], i.e. [3, 16] test=develop * refactor the code of matmul with multiple head even different width and height test=develop		5 years ago
..
contrib/float16	fix deadlink (#16129)	6 years ago
fluid	add support of matmul with multiple head even different width and height (#19708)	5 years ago
scripts	change approve site (#19791)	5 years ago
testing	Replace TemporaryAllocator by CUDADeviceContextAllocator (#18989)	5 years ago
.common_test_util.sh	fix spelling errors (#17941)	6 years ago
.gitignore	…
.set_port.sh	…
.set_python_path.sh	…
CMakeLists.txt	update CMakeLists.txt	6 years ago