Skip to content

Issue for Communication #2

@lylehust

Description

@lylehust

I installed apple-to-openai successfully in my Mac mini M4, as following. Mac OS is 26.3.1.

$ uv run apple-to-openai
INFO: Started server process [40806]
INFO: Waiting for application startup.
INFO: Application startup complete.
INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit)

And, also could get health and models information.
$ curl http://localhost:8000/health
{"status":"ok"}

$ curl http://localhost:8000/v1/models
{"object":"list","data":[{"id":"apple-intelligence","object":"model","created":0,"owned_by":"apple"}]}

However, I got the error message when I tried to send "What is apple intelligence" message to AI.

$ curl -N http://localhost:8000/v1/chat/completions -H "Content-Type: application/json" -d '{
"model": "apple-intelligence",
"messages": [{"role": "user", "content": "What is Apple Intelligence?"}],
"stream": true
}'
data: {"id": "chatcmpl-ed688aba07b1", "object": "chat.completion.chunk", "created": 1773705987, "model": "apple-intelligence", "choices": [{"index": 0, "delta": {"role": "assistant"}, "finish_reason": null}]}

data: {"error": {"message": "Apple Foundation Model error: Generation error (status: 255): None", "type": "server_error", "code": "provider_error"}}

How to fix the issue?

Thank you.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions