Skip to content

Conversation

@jonvanausdeln
Copy link
Contributor

@jonvanausdeln jonvanausdeln commented Jan 14, 2026

A recent assistant change causes the user to have to accept or regect edits before the turn is finished. This allows for that behavior in the edit eval.

  • Added the keep button to the assistant POM
  • Added postQuestionActions to the eval loop, allowing for samples to have additional steps after asking assistant questions. This is also needed for multi-turn evals (coming soon).

See CI run: https://github.com/posit-dev/positron/actions/runs/21191951305

QA Notes

@jonvanausdeln jonvanausdeln self-assigned this Jan 14, 2026
@github-actions
Copy link

github-actions bot commented Jan 14, 2026

E2E Tests 🚀
This PR will run tests tagged with: @:critical

readme  valid tags

@jonvanausdeln jonvanausdeln requested review from testlabauto and removed request for testlabauto January 14, 2026 20:29
@jonvanausdeln jonvanausdeln marked this pull request as ready for review January 21, 2026 00:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants