Skip to content

Upgrade the model to GPT 5.2 and add processing time in evaluation results of log agent#4398

Merged
LiliDeng merged 2 commits intomainfrom
baihua/eval_0327
Mar 31, 2026
Merged

Upgrade the model to GPT 5.2 and add processing time in evaluation results of log agent#4398
LiliDeng merged 2 commits intomainfrom
baihua/eval_0327

Conversation

@lubaihua33
Copy link
Copy Markdown
Collaborator

@lubaihua33 lubaihua33 commented Mar 27, 2026

Description

  1. Add processing time in the evaluation results of Log agent.
  2. Upgrade the model version to GPT 5.2

Related Issue

Type of Change

  • Bug fix
  • New feature
  • Breaking change
  • Refactoring
  • Documentation update

Checklist

  • Description is filled in above
  • No credentials, secrets, or internal details are included
  • Peer review requested (if not, add required peer reviewers after raising PR)
  • Tests executed and results posted below

Test Validation

Key Test Cases:

Impacted LISA Features:

Tested Azure Marketplace Images:

Test Results

Image VM Size Result
PASSED / FAILED / SKIPPED

Copilot AI review requested due to automatic review settings March 27, 2026 08:40
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR updates the AI log evaluation workflow to record per-test-case processing time and adjusts the default Azure OpenAI deployment names used by the log agent.

Changes:

  • Add per-test-case processing time collection and include it in detailed and summary evaluation logs.
  • Update default analyze() model deployment name defaults (general + software).

Comment thread lisa/ai/log_agent.py Outdated
Comment thread lisa/ai/log_agent.py
Comment thread lisa/ai/log_agent.py
@lubaihua33 lubaihua33 changed the title Baihua/eval 0327 Upgrade the model to GPT 5.2 and add processing time in evaluation results of log agent Mar 27, 2026
Copilot AI review requested due to automatic review settings March 27, 2026 08:53
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 1 out of 1 changed files in this pull request and generated 1 comment.

Comment thread lisa/ai/log_agent.py
Comment thread lisa/ai/log_agent.py
@LiliDeng LiliDeng merged commit adcf02e into main Mar 31, 2026
58 checks passed
@LiliDeng LiliDeng deleted the baihua/eval_0327 branch March 31, 2026 03:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants