CUDA/Vulkan "detected but using failed" in v3.15.0 (works in v3.14.5) on Windows 11 + CUDA 13.1

[AmzGrainRain]

Issue description

When using node-llama-cpp@3.15.0 on Windows 11 with CUDA 13.1 (RTX 4060 Laptop GPU), the inspect gpu command shows "CUDA is detected, but using it failed" and "Vulkan is detected, but using it failed". However, downgrading to node-llama-cpp@3.14.5 resolves the issue immediately (CUDA/Vulkan are marked as "available" and GPU details are displayed correctly). This issue is reproducible in a clean project (no other dependencies), indicating it's a compatibility issue with v3.15.0's prebuilt binaries (b7698) rather than an environment configuration problem.

Expected Behavior

The npx node-llama-cpp inspect gpu command should:

1. Mark CUDA and Vulkan as "available" (not "detected but using failed") in v3.15.0;
2. Display detailed GPU information (e.g., CUDA device name, VRAM usage, Vulkan devices) for NVIDIA GeForce RTX 4060 Laptop GPU;
3. Be consistent with the behavior of v3.14.5 (which works correctly).

Actual Behavior

For node-llama-cpp@3.15.0:

• inspect gpu outputs "CUDA is detected, but using it failed" and "Vulkan is detected, but using it failed";
• No CUDA/Vulkan GPU details (e.g., VRAM usage, device name) are displayed;
• Prebuilt binaries version: b7698.

Full output of npx --yes node-llama-cpp inspect gpu (v3.15.0):

OS: Windows 10.0.26100 (x64)
Node: 25.3.0 (x64)

node-llama-cpp: 3.15.0
Prebuilt binaries: b7698

CUDA: CUDA is detected, but using it failed
To resolve errors related to CUDA, see the CUDA guide: https://node-llama-cpp.withcat.ai/guide/CUDA
Vulkan: Vulkan is detected, but using it failed
To resolve errors related to Vulkan, see the Vulkan guide: https://node-llama-cpp.withcat.ai/guide/vulkan

CPU model: AMD Ryzen 7 8845H w/ Radeon 780M Graphics
Math cores: 3.4873849e-316
Used RAM: 49.47% (11.52GB/23.29GB)
Free RAM: 50.52% (11.77GB/23.29GB)
Used swap: 40.82% (17.27GB/42.29GB)
Max swap size: 42.29GB
mmap: supported

Steps to reproduce

1. install node-llama-cpp@3.15.0
2. run npx --yes node-llama-cpp inspect gpu

My Environment

Dependency	Version
Operating System	Windows 11 Enterprise LTSC 26100.7623
CPU	AMD R7 8845HS
Node.js version	25.3.0
Typescript version	5.9.3
node-llama-cpp version	3.15.0

npx --yes node-llama-cpp inspect gpu output:

OS: Windows 10.0.26100 (x64)
Node: 25.3.0 (x64)

node-llama-cpp: 3.14.5
Prebuilt binaries: b7347

CUDA: available
Vulkan: available

CUDA device: NVIDIA GeForce RTX 4060 Laptop GPU
CUDA used VRAM: 13.33% (1.07GB/8GB)
CUDA free VRAM: 86.66% (6.93GB/8GB)

Vulkan devices: NVIDIA GeForce RTX 4060 Laptop GPU, AMD Radeon 780M Graphics
Vulkan used VRAM: 7.29% (1.43GB/19.67GB)
Vulkan free VRAM: 92.7% (18.23GB/19.67GB)
Vulkan unified memory: 7.93GB (40.32%)

CPU model: AMD Ryzen 7 8845H w/ Radeon 780M Graphics
Math cores: 5.39976352e-315
Used RAM: 49.05% (11.42GB/23.29GB)
Free RAM: 50.94% (11.87GB/23.29GB)
Used swap: 40.2% (17GB/42.29GB)
Max swap size: 42.29GB
mmap: supported

Additional Context

nvcc

PS C:\Users\khlee> nvcc --version
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2025 NVIDIA Corporation
Built on Tue_Dec_16_19:27:18_Pacific_Standard_Time_2025
Cuda compilation tools, release 13.1, V13.1.115
Build cuda_13.1.r13.1/compiler.37061995_0

nvidia-smi

PS C:\Users\khlee> nvidia-smi
Wed Jan 21 15:12:31 2026
+-----------------------------------------------------------------------------------------+
| NVIDIA-SMI 591.74                 Driver Version: 591.74         CUDA Version: 13.1     |
+-----------------------------------------+------------------------+----------------------+
| GPU  Name                  Driver-Model | Bus-Id          Disp.A | Volatile Uncorr. ECC |
| Fan  Temp   Perf          Pwr:Usage/Cap |           Memory-Usage | GPU-Util  Compute M. |
|                                         |                        |               MIG M. |
|=========================================+========================+======================|
|   0  NVIDIA GeForce RTX 4060 ...  WDDM  |   00000000:01:00.0  On |                  N/A |
| N/A   39C    P8              3W /  115W |    1549MiB /   8188MiB |      3%      Default |
|                                         |                        |                  N/A |
+-----------------------------------------+------------------------+----------------------+

others

• Environment variables (CUDA_PATH) are configured correctly: C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.1
• No compilation errors during pnpm install for either version (postinstall script completes successfully)
• This issue is not related to environment configuration – it's specific to v3.15.0's prebuilt binaries (b7698)
• I am happy to help run debugging commands (e.g., collect logs, verify environment variables, test specific commands) as requested, but cannot assist with CUDA/node-gyp-specific compilation, build script modifications, or native module development for this package.(cause i don't understand cuda and node-gyp)

Relevant Features Used

• Metal support
• CUDA support
• Vulkan support
• Grammar
• Function calling

Are you willing to resolve this issue by submitting a Pull Request?

No, I don’t have the time and I’m okay to wait for the community / maintainers to resolve this issue.

[giladgd]

@AmzGrainRain Thanks for reporting this issue!

Do you have multiple CUDA versions installed?
Check what's under the directory C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA and see whether multiple versions are there.
I suspect you might have CUDA 13.1 installed, but the Nvidia driver you have installed isn't updated so CUDA 13.1 fails to use it.
A similar story might be happening with Vulkan since it depends on the Nvidia driver too.

I had to update the Vulkan and CUDA versions used to build the prebuilt binaries in 3.15.0 since llama.cpp needed new versions to successfully build Vulkan, and use new features of CUDA 13.1.
Vulkan is supposed to be backwards compatible (so updating to a newed SDK in the CI shouldn't have cause issues), so I think that might be related to the Nvidia driver.

In any case, can you please run these commands on your machine and share the output with me?

"C:\Program Files\Git\usr\bin\ldd.exe" node_modules\@node-llama-cpp\win-x64-cuda\bins\win-x64-cuda\ggml-cuda.dll
"C:\Program Files\Git\usr\bin\ldd.exe" node_modules\@node-llama-cpp\win-x64-cuda\bins\win-x64-cuda\llama-addon.node

"C:\Program Files\Git\usr\bin\ldd.exe" node_modules\@node-llama-cpp\win-x64-vulkan\bins\win-x64-vulkan\ggml-vulkan.dll
"C:\Program Files\Git\usr\bin\ldd.exe" node_modules\@node-llama-cpp\win-x64-vulkan\bins\win-x64-vulkan\llama-addon.node

[AmzGrainRain]

I did have multiple versions of the CUDA SDK installed before. However, I later uninstalled all drivers—including using DDU to completely remove the graphics drivers. The issue persisted after reinstallation, which is why I'm reaching out here to report it.
I gave it another try today, but the problem still remains:

PS D:\Commons\Desktop\New folder> pnpm init
Wrote to D:\Commons\Desktop\New folder\package.json

{
  "name": "New folder",
  "version": "1.0.0",
  "description": "",
  "main": "index.js",
  "scripts": {
    "test": "echo \"Error: no test specified\" && exit 1"
  },
  "keywords": [],
  "author": "",
  "license": "ISC",
  "packageManager": "pnpm@10.28.1"
}
PS D:\Commons\Desktop\New folder> pnpm i node-llama-cpp@3.15.0
 WARN  3 deprecated subdependencies found: are-we-there-yet@3.0.1, gauge@4.0.4, npmlog@6.0.2
Packages: +183
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Downloading @node-llama-cpp/win-x64@3.15.0: 6.83 MB/6.83 MB, done
Downloading node-llama-cpp@3.15.0: 28.03 MB/28.03 MB, done
Progress: resolved 196, reused 179, downloaded 4, added 183, done

dependencies:
+ node-llama-cpp 3.15.0

╭ Warning ───────────────────────────────────────────────────────────────────────────────────╮
│                                                                                            │
│   Ignored build scripts: node-llama-cpp@3.15.0.                                            │
│   Run "pnpm approve-builds" to pick which dependencies should be allowed to run scripts.   │
│                                                                                            │
╰────────────────────────────────────────────────────────────────────────────────────────────╯
Done in 3.6s using pnpm v10.28.1
PS D:\Commons\Desktop\New folder> pnpm approve-builds
√ Choose which packages to build (Press <space> to select, <a> to toggle all, <i> to invert selection) · node-llama-cpp

√ The next packages will now be built: node-llama-cpp.
Do you approve? (y/N) · true
node_modules/.pnpm/node-llama-cpp@3.15.0/node_modules/node-llama-cpp: Running postinstall script, done in 746ms
PS D:\Commons\Desktop\New folder> pnpm exec node-llama-cpp inspect gpu
OS: Windows 10.0.26100 (x64)
Node: 22.22.0 (x64)

node-llama-cpp: 3.15.0
Prebuilt binaries: b7698

CUDA: CUDA is detected, but using it failed
To resolve errors related to CUDA, see the CUDA guide: https://node-llama-cpp.withcat.ai/guide/CUDA
Vulkan: Vulkan is detected, but using it failed
To resolve errors related to Vulkan, see the Vulkan guide: https://node-llama-cpp.withcat.ai/guide/vulkan

CPU model: AMD Ryzen 7 8845H w/ Radeon 780M Graphics
Math cores: 0
Used RAM: 52.05% (12.12GB/23.29GB)
Free RAM: 47.94% (11.17GB/23.29GB)
Used swap: 47.42% (20.06GB/42.29GB)
Max swap size: 42.29GB
mmap: supported

Following your instructions, I ran these commands but encountered some path errors:

PS D:\Commons\Desktop\New folder> "C:\Program Files\Git\usr\bin\ldd.exe" node_modules\@node-llama-cpp\win-x64-cuda\bins\win-x64-cuda\ggml-cuda.dll
ParserError:
Line |
   1 |  … in\ldd.exe" node_modules\@node-llama-cpp\win-x64-cuda\bins\win-x64-cu …
     |                ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
     | Unexpected token 'node_modules\@node-llama-cpp\win-x64-cuda\bins\win-x64-cuda\ggml-cuda.dll' in expression or
     | statement.
PS D:\Commons\Desktop\New folder> "C:\Program Files\Git\usr\bin\ldd.exe" node_modules\@node-llama-cpp\win-x64-cuda\bins\win-x64-cuda\llama-addon.node
ParserError:
Line |
   1 |  … in\ldd.exe" node_modules\@node-llama-cpp\win-x64-cuda\bins\win-x64-cu …
     |                ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
     | Unexpected token 'node_modules\@node-llama-cpp\win-x64-cuda\bins\win-x64-cuda\llama-addon.node' in expression or
     | statement.
PS D:\Commons\Desktop\New folder> "C:\Program Files\Git\usr\bin\ldd.exe" node_modules\@node-llama-cpp\win-x64-vulkan\bins\win-x64-vulkan\ggml-vulkan.dll
ParserError:
Line |
   1 |  … in\ldd.exe" node_modules\@node-llama-cpp\win-x64-vulkan\bins\win-x64- …
     |                ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
     | Unexpected token 'node_modules\@node-llama-cpp\win-x64-vulkan\bins\win-x64-vulkan\ggml-vulkan.dll' in expression
     | or statement.
PS D:\Commons\Desktop\New folder> "C:\Program Files\Git\usr\bin\ldd.exe" node_modules\@node-llama-cpp\win-x64-vulkan\bins\win-x64-vulkan\llama-addon.node
ParserError:
Line |
   1 |  … in\ldd.exe" node_modules\@node-llama-cpp\win-x64-vulkan\bins\win-x64- …
     |                ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
     | Unexpected token 'node_modules\@node-llama-cpp\win-x64-vulkan\bins\win-x64-vulkan\llama-addon.node' in expression
     | or statement.
PS D:\Commons\Desktop\New folder>

I checked the node_modules directory:

PS D:\Commons\Desktop\New folder> cd .\node_modules\
PS D:\Commons\Desktop\New folder\node_modules> ls

    Directory: D:\Commons\Desktop\New folder\node_modules

Mode                 LastWriteTime         Length Name
----                 -------------         ------ ----
d----           1/23/2026  3:14 PM                .bin
d----           1/23/2026  3:14 PM                .pnpm
l----           1/23/2026  3:14 PM                node-llama-cpp -> D:\Commons\Desktop\New folder\node_module
                                                  s\.pnpm\node-llama-cpp@3.15.0\node_modules\node-llama-cpp
-a---           1/23/2026  3:14 PM           9792 .modules.yaml
-a---           1/23/2026  3:14 PM            607 .pnpm-workspace-state-v1.json

PS D:\Commons\Desktop\New folder\node_modules> cd .\.pnpm\
PS D:\Commons\Desktop\New folder\node_modules\.pnpm> ls

    Directory: D:\Commons\Desktop\New folder\node_modules\.pnpm

Mode                 LastWriteTime         Length Name
----                 -------------         ------ ----
d----           1/23/2026  3:14 PM                @huggingface+jinja@0.5.3
d----           1/23/2026  3:14 PM                @kwsites+file-exists@1.1.1
d----           1/23/2026  3:14 PM                @kwsites+promise-deferred@1.1.1
d----           1/23/2026  3:14 PM                @node-llama-cpp+win-arm64@3.15.0
d----           1/23/2026  3:14 PM                @node-llama-cpp+win-x64@3.15.0
d----           1/23/2026  3:14 PM                @octokit+app@16.1.2
d----           1/23/2026  3:14 PM                @octokit+auth-app@8.1.2
d----           1/23/2026  3:14 PM                @octokit+auth-oauth-app@9.0.3
d----           1/23/2026  3:14 PM                @octokit+auth-oauth-device@8.0.3
d----           1/23/2026  3:14 PM                @octokit+auth-oauth-user@6.0.2
d----           1/23/2026  3:14 PM                @octokit+auth-token@6.0.0
d----           1/23/2026  3:14 PM                @octokit+auth-unauthenticated@7.0.3
d----           1/23/2026  3:14 PM                @octokit+core@7.0.6
d----           1/23/2026  3:14 PM                @octokit+endpoint@11.0.2
d----           1/23/2026  3:14 PM                @octokit+graphql@9.0.3
d----           1/23/2026  3:14 PM                @octokit+oauth-app@8.0.3
d----           1/23/2026  3:14 PM                @octokit+oauth-authorization-url@8.0.0
d----           1/23/2026  3:14 PM                @octokit+oauth-methods@6.0.2
d----           1/23/2026  3:14 PM                @octokit+openapi-types@27.0.0
d----           1/23/2026  3:14 PM                @octokit+openapi-webhooks-types@12.1.0
d----           1/23/2026  3:14 PM                @octokit+plugin-paginate-graphql@6.0.0_@octokit+core@7.0.6
d----           1/23/2026  3:14 PM                @octokit+plugin-paginate-rest@14.0.0_@octokit+core@7.0.6
d----           1/23/2026  3:14 PM                @octokit+plugin-rest-endpoi_88f1cfdccbcd12f9bd89a662a3d08bce
d----           1/23/2026  3:14 PM                @octokit+plugin-retry@8.0.3_@octokit+core@7.0.6
d----           1/23/2026  3:14 PM                @octokit+plugin-throttling@11.0.3_@octokit+core@7.0.6
d----           1/23/2026  3:14 PM                @octokit+request-error@7.1.0
d----           1/23/2026  3:14 PM                @octokit+request@10.0.7
d----           1/23/2026  3:14 PM                @octokit+types@16.0.0
d----           1/23/2026  3:14 PM                @octokit+webhooks-methods@6.0.0
d----           1/23/2026  3:14 PM                @octokit+webhooks@14.2.0
d----           1/23/2026  3:14 PM                @reflink+reflink-win32-x64-msvc@0.1.19
d----           1/23/2026  3:14 PM                @reflink+reflink@0.1.19
d----           1/23/2026  3:14 PM                @tinyhttp+content-disposition@2.2.3
d----           1/23/2026  3:14 PM                @types+aws-lambda@8.10.160
d----           1/23/2026  3:14 PM                ansi-escapes@6.2.1
d----           1/23/2026  3:14 PM                ansi-regex@5.0.1
d----           1/23/2026  3:14 PM                ansi-regex@6.2.2
d----           1/23/2026  3:14 PM                ansi-styles@4.3.0
d----           1/23/2026  3:14 PM                ansi-styles@6.2.3
d----           1/23/2026  3:14 PM                aproba@2.1.0
d----           1/23/2026  3:14 PM                are-we-there-yet@3.0.1
d----           1/23/2026  3:14 PM                async-retry@1.3.3
d----           1/23/2026  3:14 PM                asynckit@0.4.0
d----           1/23/2026  3:14 PM                axios@1.13.2_debug@4.4.3
d----           1/23/2026  3:14 PM                before-after-hook@4.0.0
d----           1/23/2026  3:14 PM                bottleneck@2.19.5
d----           1/23/2026  3:14 PM                bytes@3.1.2
d----           1/23/2026  3:14 PM                call-bind-apply-helpers@1.0.2
d----           1/23/2026  3:14 PM                chalk@5.6.2
d----           1/23/2026  3:14 PM                chmodrp@1.0.2
d----           1/23/2026  3:14 PM                chownr@2.0.0
d----           1/23/2026  3:14 PM                ci-info@4.3.1
d----           1/23/2026  3:14 PM                cli-cursor@5.0.0
d----           1/23/2026  3:14 PM                cli-spinners@2.9.2
d----           1/23/2026  3:14 PM                cliui@8.0.1
d----           1/23/2026  3:14 PM                cmake-js@7.4.0
d----           1/23/2026  3:14 PM                color-convert@2.0.1
d----           1/23/2026  3:14 PM                color-name@1.1.4
d----           1/23/2026  3:14 PM                color-support@1.1.3
d----           1/23/2026  3:14 PM                combined-stream@1.0.8
d----           1/23/2026  3:14 PM                commander@10.0.1
d----           1/23/2026  3:14 PM                console-control-strings@1.1.0
d----           1/23/2026  3:14 PM                cross-spawn@7.0.6
d----           1/23/2026  3:14 PM                debug@4.4.3
d----           1/23/2026  3:14 PM                deep-extend@0.6.0
d----           1/23/2026  3:14 PM                delayed-stream@1.0.0
d----           1/23/2026  3:14 PM                delegates@1.0.0
d----           1/23/2026  3:14 PM                dunder-proto@1.0.1
d----           1/23/2026  3:14 PM                emoji-regex@10.6.0
d----           1/23/2026  3:14 PM                emoji-regex@8.0.0
d----           1/23/2026  3:14 PM                env-var@7.5.0
d----           1/23/2026  3:14 PM                es-define-property@1.0.1
d----           1/23/2026  3:14 PM                es-errors@1.3.0
d----           1/23/2026  3:14 PM                es-object-atoms@1.1.1
d----           1/23/2026  3:14 PM                es-set-tostringtag@2.1.0
d----           1/23/2026  3:14 PM                escalade@3.2.0
d----           1/23/2026  3:14 PM                eventemitter3@5.0.4
d----           1/23/2026  3:14 PM                fast-content-type-parse@3.0.0
d----           1/23/2026  3:14 PM                filename-reserved-regex@3.0.0
d----           1/23/2026  3:14 PM                filenamify@6.0.0
d----           1/23/2026  3:14 PM                follow-redirects@1.15.11_debug@4.4.3
d----           1/23/2026  3:14 PM                form-data@4.0.5
d----           1/23/2026  3:14 PM                fs-extra@11.3.3
d----           1/23/2026  3:14 PM                fs-minipass@2.1.0
d----           1/23/2026  3:14 PM                function-bind@1.1.2
d----           1/23/2026  3:14 PM                gauge@4.0.4
d----           1/23/2026  3:14 PM                get-caller-file@2.0.5
d----           1/23/2026  3:14 PM                get-east-asian-width@1.4.0
d----           1/23/2026  3:14 PM                get-intrinsic@1.3.0
d----           1/23/2026  3:14 PM                get-proto@1.0.1
d----           1/23/2026  3:14 PM                gopd@1.2.0
d----           1/23/2026  3:14 PM                graceful-fs@4.2.11
d----           1/23/2026  3:14 PM                has-symbols@1.1.0
d----           1/23/2026  3:14 PM                has-tostringtag@1.0.2
d----           1/23/2026  3:14 PM                has-unicode@2.0.1
d----           1/23/2026  3:14 PM                hasown@2.0.2
d----           1/23/2026  3:14 PM                ignore@7.0.5
d----           1/23/2026  3:14 PM                inherits@2.0.4
d----           1/23/2026  3:14 PM                ini@1.3.8
d----           1/23/2026  3:14 PM                ipull@3.9.3
d----           1/23/2026  3:14 PM                is-fullwidth-code-point@3.0.0
d----           1/23/2026  3:14 PM                is-fullwidth-code-point@5.1.0
d----           1/23/2026  3:14 PM                is-interactive@2.0.0
d----           1/23/2026  3:14 PM                is-unicode-supported@1.3.0
d----           1/23/2026  3:14 PM                is-unicode-supported@2.1.0
d----           1/23/2026  3:14 PM                isexe@2.0.0
d----           1/23/2026  3:14 PM                isexe@3.1.1
d----           1/23/2026  3:14 PM                jsonfile@6.2.0
d----           1/23/2026  3:14 PM                lifecycle-utils@2.1.0
d----           1/23/2026  3:14 PM                lifecycle-utils@3.0.1
d----           1/23/2026  3:14 PM                lodash.debounce@4.0.8
d----           1/23/2026  3:14 PM                log-symbols@6.0.0
d----           1/23/2026  3:14 PM                log-symbols@7.0.1
d----           1/23/2026  3:14 PM                lowdb@7.0.1
d----           1/23/2026  3:14 PM                math-intrinsics@1.1.0
d----           1/23/2026  3:14 PM                memory-stream@1.0.0
d----           1/23/2026  3:14 PM                mime-db@1.52.0
d----           1/23/2026  3:14 PM                mime-types@2.1.35
d----           1/23/2026  3:14 PM                mimic-function@5.0.1
d----           1/23/2026  3:14 PM                minimist@1.2.8
d----           1/23/2026  3:14 PM                minipass@3.3.6
d----           1/23/2026  3:14 PM                minipass@5.0.0
d----           1/23/2026  3:14 PM                minizlib@2.1.2
d----           1/23/2026  3:14 PM                mkdirp@1.0.4
d----           1/23/2026  3:14 PM                ms@2.1.3
d----           1/23/2026  3:14 PM                nanoid@5.1.6
d----           1/23/2026  3:14 PM                node_modules
d----           1/23/2026  3:14 PM                node-addon-api@8.5.0
d----           1/23/2026  3:14 PM                node-api-headers@1.7.0
d----           1/23/2026  3:14 PM                node-llama-cpp@3.15.0
d----           1/23/2026  3:14 PM                npmlog@6.0.2
d----           1/23/2026  3:14 PM                octokit@5.0.5
d----           1/23/2026  3:14 PM                onetime@7.0.0
d----           1/23/2026  3:14 PM                ora@8.2.0
d----           1/23/2026  3:14 PM                parse-ms@3.0.0
d----           1/23/2026  3:14 PM                parse-ms@4.0.0
d----           1/23/2026  3:14 PM                path-key@3.1.1
d----           1/23/2026  3:14 PM                pretty-bytes@6.1.1
d----           1/23/2026  3:14 PM                pretty-ms@8.0.0
d----           1/23/2026  3:14 PM                pretty-ms@9.3.0
d----           1/23/2026  3:14 PM                proper-lockfile@4.1.2
d----           1/23/2026  3:14 PM                proxy-from-env@1.1.0
d----           1/23/2026  3:14 PM                rc@1.2.8
d----           1/23/2026  3:14 PM                readable-stream@3.6.2
d----           1/23/2026  3:14 PM                require-directory@2.1.1
d----           1/23/2026  3:14 PM                restore-cursor@5.1.0
d----           1/23/2026  3:14 PM                retry@0.12.0
d----           1/23/2026  3:14 PM                retry@0.13.1
d----           1/23/2026  3:14 PM                safe-buffer@5.2.1
d----           1/23/2026  3:14 PM                semver@7.7.3
d----           1/23/2026  3:14 PM                set-blocking@2.0.0
d----           1/23/2026  3:14 PM                shebang-command@2.0.0
d----           1/23/2026  3:14 PM                shebang-regex@3.0.0
d----           1/23/2026  3:14 PM                signal-exit@3.0.7
d----           1/23/2026  3:14 PM                signal-exit@4.1.0
d----           1/23/2026  3:14 PM                simple-git@3.30.0
d----           1/23/2026  3:14 PM                sleep-promise@9.1.0
d----           1/23/2026  3:14 PM                slice-ansi@7.1.2
d----           1/23/2026  3:14 PM                stdin-discarder@0.2.2
d----           1/23/2026  3:14 PM                stdout-update@4.0.1
d----           1/23/2026  3:14 PM                steno@4.0.2
d----           1/23/2026  3:14 PM                string_decoder@1.3.0
d----           1/23/2026  3:14 PM                string-width@4.2.3
d----           1/23/2026  3:14 PM                string-width@7.2.0
d----           1/23/2026  3:14 PM                strip-ansi@6.0.1
d----           1/23/2026  3:14 PM                strip-ansi@7.1.2
d----           1/23/2026  3:14 PM                strip-json-comments@2.0.1
d----           1/23/2026  3:14 PM                tar@6.2.1
d----           1/23/2026  3:14 PM                toad-cache@3.7.0
d----           1/23/2026  3:14 PM                universal-github-app-jwt@2.2.2
d----           1/23/2026  3:14 PM                universal-user-agent@7.0.3
d----           1/23/2026  3:14 PM                universalify@2.0.1
d----           1/23/2026  3:14 PM                url-join@4.0.1
d----           1/23/2026  3:14 PM                util-deprecate@1.0.2
d----           1/23/2026  3:14 PM                validate-npm-package-name@6.0.2
d----           1/23/2026  3:14 PM                which@2.0.2
d----           1/23/2026  3:14 PM                which@5.0.0
d----           1/23/2026  3:14 PM                wide-align@1.1.5
d----           1/23/2026  3:14 PM                wrap-ansi@7.0.0
d----           1/23/2026  3:14 PM                y18n@5.0.8
d----           1/23/2026  3:14 PM                yallist@4.0.0
d----           1/23/2026  3:14 PM                yargs-parser@21.1.1
d----           1/23/2026  3:14 PM                yargs@17.7.2
d----           1/23/2026  3:14 PM                yoctocolors@2.1.2
-a---           1/23/2026  3:14 PM          52525 lock.yaml

PS D:\Commons\Desktop\New folder\node_modules\.pnpm>

I then searched for all files ending with .dll:

PS D:\Commons\Desktop\New folder> Get-ChildItem -Path .\node_modules -Recurse -File -Filter "*.dll"

    Directory: D:\Commons\Desktop\New
folder\node_modules\.pnpm\@node-llama-cpp+win-arm64@3.15.0\node_modules\@node-llama-cpp\win-arm64\bins\win-arm64

Mode                 LastWriteTime         Length Name
----                 -------------         ------ ----
-a---           1/23/2026  3:14 PM         780800 ggml-base.dll
-a---           1/23/2026  3:14 PM        1111040 ggml-cpu.dll
-a---           1/23/2026  3:14 PM         167424 ggml.b7698.dll
-a---           1/23/2026  3:14 PM        5296640 llama.b7698.dll

    Directory: D:\Commons\Desktop\New
folder\node_modules\.pnpm\@node-llama-cpp+win-x64@3.15.0\node_modules\@node-llama-cpp\win-x64\bins\win-x64

Mode                 LastWriteTime         Length Name
----                 -------------         ------ ----
-a---           1/23/2026  3:14 PM         823296 ggml-base.dll
-a---           1/23/2026  3:14 PM        1551872 ggml-cpu-alderlake.dll
-a---           1/23/2026  3:14 PM        1824256 ggml-cpu-cannonlake.dll
-a---           1/23/2026  3:14 PM        1820672 ggml-cpu-cascadelake.dll
-a---           1/23/2026  3:14 PM        1820672 ggml-cpu-cooperlake.dll
-a---           1/23/2026  3:14 PM        1554432 ggml-cpu-haswell.dll
-a---           1/23/2026  3:14 PM        1821184 ggml-cpu-icelake.dll
-a---           1/23/2026  3:14 PM        1553920 ggml-cpu-ivybridge.dll
-a---           1/23/2026  3:14 PM        1553920 ggml-cpu-piledriver.dll
-a---           1/23/2026  3:14 PM        1553920 ggml-cpu-sandybridge.dll
-a---           1/23/2026  3:14 PM        2527232 ggml-cpu-sapphirerapids.dll
-a---           1/23/2026  3:14 PM        1823744 ggml-cpu-skylakex.dll
-a---           1/23/2026  3:14 PM        1553408 ggml-cpu-sse42.dll
-a---           1/23/2026  3:14 PM        1553408 ggml-cpu-x64.dll
-a---           1/23/2026  3:14 PM        1820672 ggml-cpu-zen4.dll
-a---           1/23/2026  3:14 PM         184832 ggml.b7698.dll
-a---           1/23/2026  3:14 PM        5536768 llama.b7698.dll

PS D:\Commons\Desktop\New folder>

and all files ending with .node:

PS D:\Commons\Desktop\New folder> Get-ChildItem -Path .\node_modules -Recurse -File -Filter "*.node"

    Directory: D:\Commons\Desktop\New
folder\node_modules\.pnpm\@node-llama-cpp+win-arm64@3.15.0\node_modules\@node-llama-cpp\win-arm64\bins\win-arm64

Mode                 LastWriteTime         Length Name
----                 -------------         ------ ----
-a---           1/23/2026  3:14 PM         715776 llama-addon.node

    Directory: D:\Commons\Desktop\New
folder\node_modules\.pnpm\@node-llama-cpp+win-x64@3.15.0\node_modules\@node-llama-cpp\win-x64\bins\win-x64

Mode                 LastWriteTime         Length Name
----                 -------------         ------ ----
-a---           1/23/2026  3:14 PM         756224 llama-addon.node

    Directory: D:\Commons\Desktop\New
folder\node_modules\.pnpm\@reflink+reflink-win32-x64-msvc@0.1.19\node_modules\@reflink\reflink-win32-x64-msvc

Mode                 LastWriteTime         Length Name
----                 -------------         ------ ----
-a---           1/23/2026  3:09 PM         361472 reflink.win32-x64-msvc.node

PS D:\Commons\Desktop\New folder>

This seems like the package manager did not install @node-llama-cpp/win-x64-cuda as expected.

[AmzGrainRain]

These are all my environment variables:

PS D:\Commons\Desktop\New folder> $env:PATH -split ';' | ForEach-Object {
>>     if ($_ -ne '') {
>>         [PSCustomObject]@{
>>             'PATH' = $_
>>         }
>>     }
>> } | Format-Table -AutoSize

PATH
----
C:\Program Files\PowerShell\7
C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.1\bin\x64
C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.1\bin
c:\windows\system32
c:\windows
c:\windows\system32\wbem
c:\windows\system32\windowspowershell\v1.0\
c:\windows\system32\openssh\
c:\programdata\chocolatey\bin
c:\program files\nvidia corporation\nvidia nvdlisr
c:\program files\openssl-win64\bin\
c:\program files\git\cmd
c:\program files\dotnet\
c:\program files\tesseract-ocr\
c:\program files\powershell\7\
c:\program files\cmake\bin
c:\program files\espeak ng\
c:\program files (x86)\windows kits\10\windows performance toolkit\
C:\Program Files (x86)\NVIDIA Corporation\PhysX\Common
C:\Program Files\NVIDIA Corporation\NVIDIA App\NvDLISR
C:\Users\khlee\.pyenv\pyenv-win\bin
C:\Users\khlee\.pyenv\pyenv-win\shims
C:\Users\khlee\AppData\Local\Microsoft\WindowsApps
C:\Program Files\Microsoft Visual Studio\18\Community\VC\Tools\MSVC\14.50.35717\bin\Hostx64\x64\
D:\Commons\Executable\
D:\Commons\Executable\adb\
D:\Commons\Executable\ffmpeg\
D:\Commons\Executable\node\
D:\Commons\Executable\vcpkg\
D:\Commons\Executable\ImageMagic\
D:\Commons\Executable\upx\
C:\Users\khlee\.dotnet\tools
C:\Users\khlee\AppData\Local\Programs\Fiddler
C:\Users\khlee\.lmstudio\bin
C:\Users\khlee\AppData\Local\Programs\Microsoft VS Code\bin
C:\Users\khlee\AppData\Local\Microsoft\WinGet\Packages\JernejSimoncic.Wget_Microsoft.Winget.Source_8wekyb3d8bbwe
C:\Users\khlee\AppData\Local\pnpm
D:\Commons\Executable\zulu\21\bin\

PS D:\Commons\Desktop\New folder> Get-ChildItem Env:

Name                           Value
----                           -----
ALLUSERSPROFILE                C:\ProgramData
APPDATA                        C:\Users\khlee\AppData\Roaming
ChocolateyInstall              C:\ProgramData\chocolatey
ChocolateyLastPathUpdate       133990406292413805
CommonProgramFiles             C:\Program Files\Common Files
CommonProgramFiles(x86)        C:\Program Files (x86)\Common Files
CommonProgramW6432             C:\Program Files\Common Files
COMMONS                        D:\Commons
ComSpec                        C:\WINDOWS\system32\cmd.exe
CUDA_PATH                      C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.1
CUDA_PATH_V13_1                C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.1
DESKTOP                        D:\Commons\Desktop
DriverData                     C:\Windows\System32\Drivers\DriverData
HOMEDRIVE                      C:
HOMEPATH                       \Users\khlee
JAVA_HOME                      D:\Commons\Executable\zulu\21
LOCALAPPDATA                   C:\Users\khlee\AppData\Local
NODE_OPTIONS                   --experimental-vm-modules
NUMBER_OF_PROCESSORS           16
OS                             Windows_NT
Path                           C:\Program Files\PowerShell\7;C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.1\bin\x64;C:\Program …
PATHEXT                        .COM;.EXE;.BAT;.CMD;.VBS;.VBE;.JS;.JSE;.WSF;.WSH;.MSC;.CPL
PNPM_HOME                      C:\Users\khlee\AppData\Local\pnpm
ProgramData                    C:\ProgramData
ProgramFiles                   C:\Program Files
ProgramFiles(x86)              C:\Program Files (x86)
ProgramW6432                   C:\Program Files
PSModulePath                   D:\Commons\Documents\PowerShell\Modules;C:\Program Files\PowerShell\Modules;c:\program files\powershell\7\…
PUBLIC                         C:\Users\Public
PYENV                          C:\Users\khlee\.pyenv\pyenv-win\
PYENV_HOME                     C:\Users\khlee\.pyenv\pyenv-win\
PYENV_ROOT                     C:\Users\khlee\.pyenv\pyenv-win\
PYTHON_BUILD_MIRROR_URL        https://mirrors.huaweicloud.com/python/
PYTHON_UTILS                   D:\Commons\PyUtils
SESSIONNAME                    Console
SystemDrive                    C:
SystemRoot                     C:\WINDOWS
TEMP                           C:\Users\khlee\AppData\Local\Temp
TMP                            C:\Users\khlee\AppData\Local\Temp
VCPKG_ROOT                     D:\Commons\Executable\vcpkg
windir                         C:\WINDOWS

PS D:\Commons\Desktop\New folder>