Skip to content

Update xAI model handling#314534

Draft
pwang347 wants to merge 1 commit intomainfrom
pawang/xaiUpdates
Draft

Update xAI model handling#314534
pwang347 wants to merge 1 commit intomainfrom
pawang/xaiUpdates

Conversation

@pwang347
Copy link
Copy Markdown
Member

@pwang347 pwang347 commented May 5, 2026

No description provided.

Copilot AI review requested due to automatic review settings May 5, 2026 20:11
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR broadens xAI (Grok) model detection from the specific grok-code* family to all grok* families and uses that shared classification to adjust model capabilities, prompts, and Responses API request shaping in the Copilot extension.

Changes:

  • Introduces isXAIFamily() (grok*) and uses it to drive replace-string edit-tool capability decisions.
  • Disables Responses API reasoning.summary and reasoning.effort configuration for xAI models.
  • Updates agent prompt selection / CLI prompt tagging and disables the todo-list tool for xAI models.
Show a summary per file
File Description
extensions/copilot/src/platform/endpoint/node/responsesApi.ts Uses new capability helpers to gate reasoning summary/effort in Responses API request bodies (notably for xAI).
extensions/copilot/src/platform/endpoint/common/chatModelCapabilities.ts Adds isXAIFamily() and new reasoning capability helpers; updates replace-string capability checks to use xAI family detection.
extensions/copilot/src/extension/prompts/node/agent/xAIPrompts.tsx Broadens prompt resolver matching from grok-code* to grok* and renames the default Grok prompt class.
extensions/copilot/src/extension/prompts/node/agent/copilotCLIPrompt.tsx Switches Grok detection to isXAIFamily() for deciding whether to emit the user_query tag.
extensions/copilot/src/extension/intents/node/agentIntent.ts Switches xAI detection to isXAIFamily() to disable the todo-list tool for Grok models.

Copilot's findings

  • Files reviewed: 5/5 changed files
  • Comments generated: 1

Comment thread extensions/copilot/src/platform/endpoint/node/responsesApi.ts
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 5, 2026

Screenshot Changes

Base: dc6e1f85 Current: 3eda1b5d

Changed (10)

chat/input/chatInput/Default/Dark
Before After
before after
chat/input/chatInput/Default/Light
Before After
before after
chat/input/chatInput/WithArtifacts/Light
Before After
before after
chat/input/chatInput/WithTodos/Dark
Before After
before after
chat/input/chatInput/WithTodos/Light
Before After
before after
chat/input/chatInput/WithTodosAndFileChanges/Light
Before After
before after
chat/input/chatInput/WithArtifactsAndFileChanges/Dark
Before After
before after
chat/widget/chatWidget/SimpleQA/Light
Before After
before after
chat/widget/chatWidget/PendingToolApproval/Light
Before After
before after
chat/widget/chatWidget/MultiTurn/Light
Before After
before after

@pwang347 pwang347 added ~requires-eval-assessment Evals will be run and will generate a report upon completion and removed ~requires-eval-assessment Evals will be run and will generate a report upon completion labels May 5, 2026
@vs-code-engineering
Copy link
Copy Markdown
Contributor

⏳ Queued vscode build for 3186e5a6ab8fefff89374e073de45eac536fd954 (step 1/2).

@pwang347
Copy link
Copy Markdown
Member Author

pwang347 commented May 5, 2026

~requires-eval-assessment terminalbench2 grok-4.3

@pwang347 pwang347 added the ~requires-eval-assessment Evals will be run and will generate a report upon completion label May 5, 2026
@vs-code-engineering
Copy link
Copy Markdown
Contributor

⏳ Queued vscode build for 3186e5a6ab8fefff89374e073de45eac536fd954 (step 1/2).

@pwang347
Copy link
Copy Markdown
Member Author

pwang347 commented May 5, 2026

~requires-eval-assessment vscbench grok-4.3

@pwang347 pwang347 added the ~requires-eval-assessment Evals will be run and will generate a report upon completion label May 5, 2026
@vs-code-engineering
Copy link
Copy Markdown
Contributor

⏳ Queued vscode build for 3186e5a6ab8fefff89374e073de45eac536fd954 (step 1/2).

@pwang347 pwang347 removed the ~requires-eval-assessment Evals will be run and will generate a report upon completion label May 5, 2026
@pwang347
Copy link
Copy Markdown
Member Author

pwang347 commented May 5, 2026

~requires-eval-assessment swebench.litmus grok-4.3

@pwang347 pwang347 added the ~requires-eval-assessment Evals will be run and will generate a report upon completion label May 5, 2026
@vs-code-engineering
Copy link
Copy Markdown
Contributor

⏳ Queued vscode build for 3186e5a6ab8fefff89374e073de45eac536fd954 (step 1/2).

@vs-code-engineering
Copy link
Copy Markdown
Contributor

🚀 Queued eval-assessment publish build for 3eda1b5dfcbf0cf3e123ab8a4807548e12dba4e7 (step 2/2).

@vs-code-engineering
Copy link
Copy Markdown
Contributor

🔬 Queued eval-assessment benchmark for 0a5e792880.

Results will be posted back here when the run completes.

@vs-code-engineering
Copy link
Copy Markdown
Contributor

✅ Eval-assessment build published.

@vs-code-engineering vs-code-engineering Bot removed the ~requires-eval-assessment Evals will be run and will generate a report upon completion label May 5, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants