[SYCL] Re-enabled mul_mat_batched_sycl

[airMeng]

• I have read the contributing guidelines
• Self-reported review complexity:
  • Low
  • Medium
  • High

cherry-pick from #8057, thanks @OuadiElfarouki and @joeatodd

Before

hengyume@mlp-618:~/llama.cpp/master$ ./bin/llama-bench -m ~/llama-2-7b.Q4_0.gguf -ngl 99 -sm none -mg 0
...
|  |                   |                                       |       |Max    |        |Max  |Global |                     |
|  |                   |                                       |       |compute|Max work|sub  |mem    |                     |
|ID|        Device Type|                                   Name|Version|units  |group   |group|size   |       Driver version|
|--|-------------------|---------------------------------------|-------|-------|--------|-----|-------|---------------------|
| 0| [level_zero:gpu:0]|               Intel Arc A770M Graphics|    1.3|    512|    1024|   32| 16225M|            1.3.28202|
...
| llama 7B Q4_0                  |   3.56 GiB |     6.74 B | SYCL       |  99 |  none |         pp512 |     11.10 ± 3.48 |
| llama 7B Q4_0                  |   3.56 GiB |     6.74 B | SYCL       |  99 |  none |         tg128 |     26.38 ± 0.15 |

build: d62e4aaa (3215)

After

hengyume@mlp-618:~/llama.cpp/build$ ./bin/llama-bench -m ~/llama-2-7b.Q4_0.gguf -ngl 99 -sm none -mg 0
...
|  |                   |                                       |       |Max    |        |Max  |Global |                     |
|  |                   |                                       |       |compute|Max work|sub  |mem    |                     |
|ID|        Device Type|                                   Name|Version|units  |group   |group|size   |       Driver version|
|--|-------------------|---------------------------------------|-------|-------|--------|-----|-------|---------------------|
| 0| [level_zero:gpu:0]|               Intel Arc A770M Graphics|    1.3|    512|    1024|   32| 16225M|            1.3.28202|
...
| llama 7B Q4_0                  |   3.56 GiB |     6.74 B | SYCL       |  99 |  none |         pp512 |  212.07 ± 335.47 |
| llama 7B Q4_0                  |   3.56 GiB |     6.74 B | SYCL       |  99 |  none |         tg128 |     28.74 ± 0.13 |

build: a8a9f6c1 (3216)

[OuadiElfarouki]

Sounds good! We wanted to confirm the performance improvements on the master branch from this patch alone first (as the sycl-main includes other improvements) but it should be fine at this level!