You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Follow the guide to install OpenVINO Runtime from an archive file: [Linux](https://docs.openvino.ai/2026/get-started/install-openvino/install-openvino-archive-linux.html) | [Windows](https://docs.openvino.ai/2026/get-started/install-openvino/install-openvino-archive-windows.html)
180
+
181
+
- **Linux:**
182
+
183
+
<details>
184
+
<summary>📦 Click to expand OpenVINO installation from an archive file on Ubuntu</summary>
Although OpenVINO supports a wide range of [Intel hardware](https://docs.openvino.ai/2026/about-openvino/release-notes-openvino/system-requirements.html), the llama.cpp OpenVINO backend has been validated specifically on AI PCs such as the Intel® Core™ Ultra Series 1 and Series 2.
208
+
209
+
More Information see: https://github.com/ggml-org/llama.cpp/blob/master/docs/backend/OPENVINO.md
210
+
211
+
To install with OpenVINO, set the `GGML_OPENVINO=ON` environment variable before installing:
@@ -213,7 +266,20 @@ More details see here: https://github.com/ggml-org/llama.cpp/blob/master/docs/bu
213
266
214
267
- For Windows User: Download and install the [`Vulkan SDK`](https://vulkan.lunarg.com/sdk/home#windows) with the default settings.
215
268
216
-
- For Linux User: Follow the official LunarG instructions for the installation and setup of the Vulkan SDK in the [Getting Started with the Linux Tarball Vulkan SDK](https://vulkan.lunarg.com/doc/sdk/latest/linux/getting_started.html) guide.
269
+
- For Linux User:
270
+
* First, follow the official LunarG instructions for the installation and setup of the Vulkan SDK in the [Getting Started with the Linux Tarball Vulkan SDK](https://vulkan.lunarg.com/doc/sdk/latest/linux/getting_started.html) guide.
271
+
272
+
* After completing the first step, ensure that you have used the `source` command on the `setup_env.sh` file inside of the Vulkan SDK in your current terminal session. Otherwise, the build won't work. Additionally, if you close out of your terminal, you must perform this step again if you intend to perform a build. However, there are ways to make this persistent. Refer to the Vulkan SDK guide linked in the first step for more information about any of this.
273
+
274
+
- For Mac User:
275
+
* Generally, follow LunarG's [Getting Started with the MacOS Vulkan SDK](https://vulkan.lunarg.com/doc/sdk/latest/mac/getting_started.html) guide for installation and setup of the Vulkan SDK. There are two options of Vulkan drivers on macOS, both of which implement translation layers to map Vulkan to Metal. They can be hot-swapped by setting the `VK_ICD_FILENAMES` environment variable to point to the respective ICD JSON file. Check the box for "KosmicKrisp" during the LunarG Vulkan SDK installation.
276
+
277
+
* Set environment variable for the LunarG Vulkan SDK after installation (and optionally add to your shell profile for persistence):
278
+
```bash
279
+
source /path/to/vulkan-sdk/setup-env.sh
280
+
```
281
+
282
+
More Information see: https://github.com/ggml-org/llama.cpp/blob/master/docs/build.md#vulkan
217
283
218
284
Then install with Vulkan support by set the `GGML_VULKAN=on` environment variable before installing:
| Linux | Support | Ubuntu 22.04, Fedora Silverblue 39, Arch Linux |
300
+
| Windows | Support | Windows 11 |
301
+
302
+
### Intel GPU
303
+
304
+
SYCL backend supports Intel GPU Family:
305
+
306
+
- Intel Data Center Max Series
307
+
- Intel Flex Series, Arc Series
308
+
- Intel Built-in Arc GPU
309
+
- Intel iGPU in Core CPU (11th Generation Core CPU and newer, refer to [oneAPI supported GPU](https://www.intel.com/content/www/us/en/developer/articles/system-requirements/intel-oneapi-base-toolkit-system-requirements.html#inpage-nav-1-1)).
310
+
311
+
On older Intel GPUs, you may try [OpenCL](/docs/backend/OPENCL.md) although the performance is not optimal, and some GPUs may not support OpenCL nor have any GPGPU capabilities.
312
+
313
+
More Information see here: https://github.com/ggml-org/llama.cpp/blob/master/docs/backend/SYCL.md
314
+
229
315
To install with SYCL support, set the `GGML_SYCL=on` environment variable before installing:
230
316
231
317
```bash
232
-
source /opt/intel/oneapi/setvars.sh
318
+
# Export relevant ENV variables
319
+
source /opt/intel/oneapi/setvars.sh
320
+
# Option 1: Use FP32 (recommended for better performance in most cases)
0 commit comments