Skip to content

UI tests experiments#25375

Draft
mokagio wants to merge 5 commits intotrunkfrom
mokagio/ui-tests-tweaks
Draft

UI tests experiments#25375
mokagio wants to merge 5 commits intotrunkfrom
mokagio/ui-tests-tweaks

Conversation

@mokagio
Copy link
Contributor

@mokagio mokagio commented Mar 13, 2026

Description

Testing instructions

Follow up to #25345

mokagio and others added 3 commits March 13, 2026 14:17
The function is provided by a CI plugin and adds Buildkite annotations for test failures.
This custom handling is no longer needed.

---

Generated with the help of Claude Code, https://claude.ai/code

Co-Authored-By: Claude Code Opus 4.6 <noreply@anthropic.com>
Every recent test failure has been due to tests timing out,
see for example:

https://buildkite.com/automattic/wordpress-ios/builds/31460/steps/canvas?sid=019ce44a-1833-4b6d-9c50-d0492ad0053b&tab=output

This commit removes timeouts at the Xcode level to see what happens.
@dangermattic
Copy link
Collaborator

1 Message
📖 This PR is still a Draft: some checks will be skipped.

Generated by 🚫 Danger

@wpmobilebot
Copy link
Contributor

wpmobilebot commented Mar 13, 2026

App Icon📲 You can test the changes from this Pull Request in Jetpack by scanning the QR code below to install the corresponding build.
App NameJetpack
ConfigurationRelease-Alpha
Build Number31463
VersionPR #25375
Bundle IDcom.jetpack.alpha
Commit62f3f56
Installation URL3rc1jofp4bhg0
Automatticians: You can use our internal self-serve MC tool to give yourself access to those builds if needed.

@wpmobilebot
Copy link
Contributor

wpmobilebot commented Mar 13, 2026

App Icon📲 You can test the changes from this Pull Request in WordPress by scanning the QR code below to install the corresponding build.
App NameWordPress
ConfigurationRelease-Alpha
Build Number31463
VersionPR #25375
Bundle IDorg.wordpress.alpha
Commit62f3f56
Installation URL5bv16961brc28
Automatticians: You can use our internal self-serve MC tool to give yourself access to those builds if needed.

@wpmobilebot
Copy link
Contributor

wpmobilebot commented Mar 13, 2026

🤖 Build Failure Analysis

This build has failures. Claude has analyzed them - check the build annotations for details.

@mokagio
Copy link
Contributor Author

mokagio commented Mar 13, 2026

@crazytonyli @iangmaia following up on #25345, I've removed the timeout config which seemed to be a cause of some failures, now it does seem that some tests are retried, but others aren't

Retried:

image

Not retried (see only one match in the logs search):

image

Investigating whether parallel testing interferes with the test plan's
`retryOnFailure` repetition mode.

---

Generated with the help of Claude Code, https://claude.ai/code

Co-Authored-By: Claude Code Opus 4.6 <noreply@anthropic.com>
@sonarqubecloud
Copy link

@crazytonyli
Copy link
Contributor

Hey @mokagio, thanks for looking into the UI tests. Just want to let you know, we are considering deleting the UI tests (p1772671233317549/1772599424.596319-slack-C04PWEZSYFL).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants