Skip to content

chore(e2e): Added Testiny Run parameter and optional reporting of e2e test run to Testiny [WPB-20496]#20516

Merged
iskvortsov merged 18 commits intodevfrom
chore/WPB-20496_add_Testiny_Run_parameter_and_reporting_to_Testiny
Mar 3, 2026
Merged

chore(e2e): Added Testiny Run parameter and optional reporting of e2e test run to Testiny [WPB-20496]#20516
iskvortsov merged 18 commits intodevfrom
chore/WPB-20496_add_Testiny_Run_parameter_and_reporting_to_Testiny

Conversation

@iskvortsov
Copy link
Contributor

@iskvortsov iskvortsov commented Feb 26, 2026

TaskWPB-20496 [Web/QA] Import results of the playwright regression to Testiny when a Testiny run has been supplied to Github Action

Pull Request

Summary

https://wearezeta.atlassian.net/browse/WPB-20496

  • Changed e2e-tests.yml to handle additional parameter
  • Added send-playwright-results-to-testiny.ts to process and send results to Testiny

Security Checklist (required)

  • External inputs are validated & sanitized on client and/or server where applicable.
  • API responses are validated; unexpected shapes are handled safely (fallbacks or errors).
  • No unsafe HTML is rendered; if unavoidable, sanitization is applied and documented where it happens.
  • Injection risks (XSS/SQL/command) are prevented via safe APIs and/or escaping.

Accessibility (required)

Standards Acknowledgement (required)


Screenshots or demo (if the user interface changed)

Notes for reviewers

  • Trade-offs:
  • Follow-ups (linked issues):
  • Linked PRs (e.g. web-packages):

@codecov
Copy link

codecov bot commented Feb 26, 2026

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 45.49%. Comparing base (e693bfe) to head (7cfe2ab).
⚠️ Report is 1 commits behind head on dev.

Additional details and impacted files
@@           Coverage Diff           @@
##              dev   #20516   +/-   ##
=======================================
  Coverage   45.49%   45.49%           
=======================================
  Files        1640     1640           
  Lines       40434    40434           
  Branches     8349     8349           
=======================================
+ Hits        18394    18395    +1     
  Misses      20102    20102           
+ Partials     1938     1937    -1     
Flag Coverage Δ
app_webapp 43.71% <ø> (+<0.01%) ⬆️
lib_api_client 50.17% <ø> (ø)
lib_core 59.01% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.
see 1 file with indirect coverage changes

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@github-actions
Copy link
Contributor

github-actions bot commented Feb 26, 2026

🔗 Download Full Report Artifact

🧪 Playwright Test Summary

  • Passed: 195
  • Failed: 0
  • Skipped: 13
  • 🔁 Flaky: 5
  • 📊 Total: 213
  • Total Runtime: 1613.1s (~ 26 min 53 sec)
specs/Archive/archive.spec.ts (❌ 0 failed, ⚠️ 2 flaky)
  • ⚠️ Archive > Verify the conversation is not unarchived when there are new messages in this conversation (tags: TC-99, regression)
  • ⚠️ Archive > I want to archive the 1on1 conversation from conversation details (tags: TC-105, regression)
specs/Delete/delete.spec.ts (❌ 0 failed, ⚠️ 1 flaky)
  • ⚠️ Delete > I see "Deleted" status message if other user deletes their message "For Everyone" (group) (tags: TC-577, regression)
specs/Notifications/notifications.spec.ts (❌ 0 failed, ⚠️ 1 flaky)
  • ⚠️ Notifications > Verify I see notification when I receive a connection request (tags: TC-1462, regression)
specs/ParticipantProfile/participantProfile.spec.ts (❌ 0 failed, ⚠️ 1 flaky)
  • ⚠️ Participant Profile > I want to see the group admin icon as a member seeing the group admin profile (tags: TC-1485, regression)

@iskvortsov
Copy link
Contributor Author

@iskvortsov
Copy link
Contributor Author

Update: did some clean up of the file and using Playwrights classes instead of defining my own.

thisisamir98
thisisamir98 previously approved these changes Mar 2, 2026
thisisamir98
thisisamir98 previously approved these changes Mar 2, 2026
@iskvortsov iskvortsov changed the title chore(e2e): Added Testiny Run parameter and optional reporting of e2e test run to Testiny chore(e2e): Added Testiny Run parameter and optional reporting of e2e test run to Testiny [WPB-20496] Mar 2, 2026
@iskvortsov iskvortsov requested a review from thisisamir98 March 2, 2026 15:50
thisisamir98
thisisamir98 previously approved these changes Mar 2, 2026
@sonarqubecloud
Copy link

sonarqubecloud bot commented Mar 3, 2026

@iskvortsov iskvortsov added this pull request to the merge queue Mar 3, 2026
Merged via the queue into dev with commit f44c125 Mar 3, 2026
89 of 90 checks passed
@iskvortsov iskvortsov deleted the chore/WPB-20496_add_Testiny_Run_parameter_and_reporting_to_Testiny branch March 3, 2026 10:15
screendriver pushed a commit that referenced this pull request Mar 4, 2026
… test run to Testiny [WPB-20496] (#20516)

* chore(e2e): Added Testiny Run parameter and optional reporting of e2e test run to Testiny

* Resolved script injection vulnerability

* Fixed path to report and some code analysis issues

* Added async wrapper for the script's main func call

* Added slate rich-text formatting for a Test Run description field

* Applied some PR review suggestions

* Added default values for grep

* Replaced process.exit(1) occurences with process.exitCode = 1

* Moved the command for e2e tests to one line

* Added escape for "

* Fixed if condition

* Some clean up for playwright result script

* Removed tmp test API Key

* Added a copyright text and replaced npx ts-node with node in the script command

* Reduced complexity of the main function

* Added top level await

* Adding generated i18n artifacts
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants