llama.cpp 和 SYCL oneMKL 后端

在 cpu 下运行 llama.cpp

用 https://github.com/flame/blis 计算库是目前最好的选择。

SYCL

SYCL is a high-level parallel programming model designed to improve developers productivity writing code across various hardware accelerators such as CPUs, GPUs, and FPGAs. It is a single-source language designed for heterogeneous computing and based on standard C++17.

The llama.cpp SYCL backend is designed to support Intel GPU firstly. Based on the cross-platform feature of SYCL, it could support other vendor GPUs: Nvidia GPU (AMD GPU coming).
When targeting Intel CPU, it is recommended to use llama.cpp for Intel oneMKL backend.

oneMKL

When targeting Intel CPU, it is recommended to use llama.cpp for Intel oneMKL backend.

It has the similar design of other llama.cpp BLAS-based paths such as OpenBLAS, cuBLAS, etc... In beginning work, the oneAPI's SYCLomatic open-source migration tool (Commercial release Intel® DPC++ Compatibility Tool) was used for this purpose.
现在这个也在 llama.cpp 上删除支持说明文档了。