Skip to content

compose: clarify cloud provider portability section #24423

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
dvdksn wants to merge 1 commit into
base: main
Choose a base branch
from
+5 −5
Open

compose: clarify cloud provider portability section #24423

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
10 changes: 5 additions & 5 deletions content/manuals/ai/compose/models-and-compose.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -16,8 +16,7 @@ Compose lets you define AI models as core components of your application, so you
## Prerequisites

- Docker Compose v2.38 or later
- A platform that supports Compose models such as Docker Model Runner (DMR) or compatible cloud providers.
If you are using DMR, see the [requirements](/manuals/ai/model-runner/_index.md#requirements).
- A platform that supports Compose models such as [Docker Model Runner (DMR)](/manuals/ai/model-runner/_index.md#requirements).

## What are Compose models?

Expand Down Expand Up @@ -166,7 +165,7 @@ Docker Model Runner will:

### Cloud providers

The same Compose file can run on cloud providers that support Compose models:
The Compose models specification is designed to be portable. Platforms that implement the Compose specification can support the `models` top-level element, allowing the same Compose file to run on different infrastructure. Cloud-specific behavior can be configured using extension attributes (`x-*`):

```yaml
services:
Expand All @@ -184,9 +183,10 @@ models:
- "cloud.region=us-west-2"
```

Cloud providers might:
How a platform handles model definitions depends on its implementation. A platform might:

- Use managed AI services instead of running models locally
- Apply cloud-specific optimizations and scaling
- Apply platform-specific optimizations and scaling
- Provide additional monitoring and logging capabilities
- Handle model versioning and updates automatically

Expand Down
Loading