feat(openai): add new models [bot]#978
Conversation
|
/test-models |
Gateway test results
Failures (1)
Error: Code snippet# OpenAI-compatible STT (works with OpenAI and Groq)
from pathlib import Path
from openai import OpenAI
client = OpenAI(api_key="***", base_url="https://internal.devtest.truefoundry.tech/api/llm/api/llm")
audio_path = Path(__file__).parent / "hello.wav"
with open(audio_path, "rb") as audio_file:
response = client.audio.transcriptions.create(
model="test-v2-openai/gpt-realtime-whisper",
file=audio_file,
)
_stt_output = response.text
print(_stt_output)
assert _stt_output, "VALIDATION FAILED: Transcription returned empty text"
assert len(_stt_output.strip()) > 0, f"VALIDATION FAILED: Transcription is blank: '{_stt_output}'"Skipped (2)
Skip reason:
Skip reason: |
| - realtime | ||
| - chat | ||
| - responses | ||
| thinking: true |
There was a problem hiding this comment.
Thinking model missing removeParams and max_completion_tokens config
Medium Severity
gpt-realtime-2 sets thinking: true but lacks removeParams and a params entry for max_completion_tokens. Every other OpenAI thinking model (o1, o3, o4-mini, gpt-5, gpt-5-mini, gpt-5-nano, gpt-5-codex, gpt-5-pro, computer-use-preview) removes at least max_tokens and usually temperature/top_p via removeParams, and adds max_completion_tokens to params. Without these, the model inherits temperature, max_tokens, top_p, n, etc. from default.yaml, which thinking/reasoning models typically don't support.
Reviewed by Cursor Bugbot for commit 39abcc2. Configure here.
| status: active | ||
| supportedModes: | ||
| - realtime | ||
| - audio_translation |
There was a problem hiding this comment.
Translation model missing removeParams for tool-related parameters
Medium Severity
gpt-realtime-translate has no features (no function calling) and no removeParams, so it inherits tool_choice and parallel_tool_calls from default.yaml. Every other OpenAI audio model without function calling — including gpt-realtime-whisper added in this same PR, plus whisper-1, gpt-4o-transcribe, gpt-4o-mini-transcribe, and gpt-4o-transcribe-diarize — removes these params via removeParams. This translation-only model shouldn't expose tool-related parameters.
Reviewed by Cursor Bugbot for commit 39abcc2. Configure here.
|
/test-models |
There was a problem hiding this comment.
Cursor Bugbot has reviewed your changes and found 1 potential issue.
There are 3 total unresolved issues (including 2 from previous reviews).
❌ Bugbot Autofix is OFF. To automatically fix reported issues with cloud agents, enable autofix in the Cursor dashboard.
Reviewed by Cursor Bugbot for commit 728ac78. Configure here.


Auto-generated by model-addition-agent for provider
openai.Note
Low Risk
Low risk: adds new OpenAI model metadata YAMLs only (no runtime code changes), mainly affecting model availability and cost/limit configuration.
Overview
Adds three new OpenAI model specification files for realtime usage:
gpt-realtime-2,gpt-realtime-translate, andgpt-realtime-whisper.Each model entry defines pricing, token/second limits, supported modalities/modes, and any parameter overrides (e.g.,
max_tokensfor translate,removeParamsfor whisper), enabling them to be selected/configured by the existing provider model catalog.Reviewed by Cursor Bugbot for commit 728ac78. Bugbot is set up for automated code reviews on this repo. Configure here.