Skip to content

[Bug]: AutoDeploy: Investigate Mistral dense models #14014

@govind-ramnarayan

Description

@govind-ramnarayan

AutoDeploy support for these Mistral dense / Codestral / Pixtral models is currently unknown and needs investigation.

Failed models:

  • mistralai/Codestral-25.01
  • mistralai/Mistral-Large-Instruct-2407
  • mistralai/Mistral-Large-Instruct-2501

Skipped models:

  • mistralai/Mistral-Small-3.1-24B-Instruct-2503
  • mistralai/Mistral-Small-3.2-24B-Instruct-2506
  • mistralai/Mistral-Small-4-119B-2603
  • mistralai/Pixtral-12B-2409

Reproduce on cw-dfw with:

python examples/auto_deploy/build_and_run_ad.py --model <model id from above> --use-registry

Also monitor the AutoDeploy dashboard for status changes:
https://autodeploy-dashboard-a68618.gitlab-master-pages.nvidia.com/

Metadata

Metadata

Assignees

Labels

AutoDeploy<NV> AutoDeploy Backend

Type

No type

Projects

Status

Backlog

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions