Skip to content

Unable to connect with local llama.cpp #804

@chrisrp

Description

@chrisrp

I have installed llama.cpp on macOS M1 and it's running correctly as I am able to access from http://localhost:8080/.

Following here the instructions I get an error.

This is what I see at the server console:

srv log_server_r: request: GET /v1/api/version 127.0.0.1 404

Here is the server version:

$ llama-server --version                      
version: 5460 (3079e9ac)
built with Apple clang version 17.0.0 (clang-1700.0.13.3) for arm64-apple-darwin24.4.0

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions