chore: add Local Test Runner support for E2E Tests for RHDH core. #4023

subhashkhileri · 2026-01-20T07:22:49Z

Description

https://issues.redhat.com/browse/RHIDP-11483

Which issue(s) does this PR fix

Fixes #?

PR acceptance criteria

Please make sure that the following steps are complete:

GitHub Actions are completed and successful
Unit Tests are updated and passing
E2E Tests are updated and passing
Documentation is updated if necessary (requirement for new features)
Add a screenshot if the change is UX/UI related

How to test changes / Special notes to the reviewer

.ibm/pipelines/utils.sh

christoph-jerolimov · 2026-01-20T07:30:21Z

/cc @jrichter1 @christoph-jerolimov

christoph-jerolimov · 2026-01-20T07:30:57Z

/cc @teknaS47 @sanketpathak @HusneShabbir

github-actions · 2026-01-20T08:04:20Z

The image is available at:

/test e2e-ocp-helm

github-actions · 2026-01-20T11:25:42Z

The image is available at:

/test e2e-ocp-helm

github-actions · 2026-01-20T12:26:12Z

The image is available at:

/test e2e-ocp-helm

gustavolira · 2026-01-20T13:25:38Z

@subhashkhileri can you please fix the new sonar issues https://sonarcloud.io/project/issues?id=redhat-developer_rhdh&pullRequest=4023&issueStatuses=OPEN,CONFIRMED&sinceLeakPeriod=true

e2e-tests/local-test-setup.sh

e2e-tests/local-run.sh

e2e-tests/container-init.sh

zdrapela

No strong opinions here, but I have some thoughts on this 🤔

But great work overall!

.ibm/pipelines/utils.sh

zdrapela · 2026-01-21T14:03:51Z

e2e-tests/local-run.sh

+        2) JOB_NAME="periodic-ci-ocp-helm-nightly" ;;
+        3) JOB_NAME="periodic-ci-ocp-operator-nightly" ;;
+        4) JOB_NAME="periodic-ci-ocp-helm-upgrade-nightly" ;;
+        5) JOB_NAME="periodic-ci-ocp-operator-auth-providers-nightly" ;;


nit: It won't have an effect, but we can align the job names with what's really used.

Suggested change

2) JOB_NAME="periodic-ci-ocp-helm-nightly" ;;

3) JOB_NAME="periodic-ci-ocp-operator-nightly" ;;

4) JOB_NAME="periodic-ci-ocp-helm-upgrade-nightly" ;;

5) JOB_NAME="periodic-ci-ocp-operator-auth-providers-nightly" ;;

2) JOB_NAME="periodic-ci-redhat-developer-rhdh-main-ocp-helm-nightly" ;;

3) JOB_NAME="periodic-ci-redhat-developer-rhdh-main-ocp-operator-nightly" ;;

4) JOB_NAME="periodic-ci-redhat-developer-rhdh-main-ocp-helm-upgrade-nightly" ;;

5) JOB_NAME="periodic-ci-redhat-developer-rhdh-main-ocp-operator-auth-providers-nightly" ;;

its release / branch independent. the main might confuse.

Okay, we can keep it as it is

zdrapela · 2026-01-21T15:33:38Z

e2e-tests/local-run.sh

@@ -0,0 +1,335 @@
+#!/bin/bash


Personally, I prefer to have the option to use flags to configure the options that I want. The current setup with a walkthrough works fine, and it's great for a newcomer, etc. The option to rerun the same config is great. But for me, flags are unbeatable.

The flags now work great!

zdrapela · 2026-01-21T15:37:35Z

e2e-tests/container-init.sh

@@ -0,0 +1,141 @@
+#!/bin/bash


We currently have linters for bash scripts only in .ibm folder, and basically all the bash scripts related to e2e and CI are there. It can make sense to have those scripts in e2e-tests folder, but it's kind of mixing up TypeScript with Bash now 🤔

these are user-facing scripts that belong with the e2e-tests, not CI pipeline

Okay, but it would make sense to at least group them in a folder, maybe? So we can set up Prettier and ShellCheck (possibly in the future)

Co-authored-by: Zbyněk Drápela <61500440+zdrapela@users.noreply.github.com>

github-actions · 2026-01-22T04:24:18Z

🚫 Image Push Skipped.

The container image push was skipped because the build was skipped (either due to [skip-build] tag or no relevant changes with existing image)

github-actions · 2026-01-22T15:57:25Z

🚫 Image Push Skipped.

The container image push was skipped because the build was skipped (either due to [skip-build] tag or no relevant changes with existing image)

Add CLI flags (-j, -r, -t, -p, -s) to local-run.sh for automation and quick runs without interactive prompts. Also improve container-init.sh to pre-compute and save config before deployment so URLs are available even if deployment fails. Additional fixes: - Fix secrets parsing in local-test-setup.sh to handle special chars - Minor formatting fix in utils.sh for piped command Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>

github-actions · 2026-01-22T16:42:03Z

The image is available at:

zdrapela · 2026-01-23T08:43:33Z

/review
-i

rhdh-qodo-merge · 2026-01-23T08:44:18Z

Persistent review updated to latest commit 82835ea

zdrapela

I would say this is ready to be used by RHDH devs. It works as expected with OCP

zdrapela · 2026-01-23T12:22:15Z

e2e-tests/local-test-setup.sh

+log::info "To run tests:"
+echo "  cd e2e-tests"
+echo "  yarn install"
+echo "  yarn playwright test --headed"


Maybe this can contain the --project=... with the specific project. Without the project specified, it will run all of them. Also the --headed can be explained (you often want to run it headlessly)

Extend local test runner to support non-OpenShift Kubernetes platforms: - Derive CONTAINER_PLATFORM from job name (*aks*, *eks*, *gke*, *osd*) - Add platform-specific cluster login (oc for OCP/OSD, kubectl for others) - Handle service account token creation for non-OpenShift clusters - Update container-init.sh to configure kubectl context for AKS/EKS/GKE - Add interactive menu options for AKS, EKS, GKE job selection - Update help text and examples for multi-platform usage Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>

github-actions · 2026-01-26T08:48:36Z

🚫 Image Push Skipped.

The container image push was skipped because the build was skipped (either due to [skip-build] tag or no relevant changes with existing image)

github-actions · 2026-01-27T10:29:06Z

The image is available at:

sonarqubecloud · 2026-01-27T13:48:32Z

Quality Gate passed

Issues
5 New issues
0 Accepted issues

Measures
0 Security Hotspots
0.0% Coverage on New Code
0.0% Duplication on New Code

See analysis details on SonarQube Cloud

zdrapela · 2026-01-27T13:55:10Z

/lgtm

openshift-ci · 2026-01-27T13:55:19Z

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: teknaS47, zdrapela
Once this PR has been reviewed and has the lgtm label, please assign 04kash for approval. For more information see the Code Review Process.

The full list of commands accepted by this bot can be found here.

Details

Needs approval from an approver in each of these files:

OWNERS

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

github-actions · 2026-01-27T14:28:31Z

The image is available at:

openshift-ci · 2026-01-27T15:00:11Z

@subhashkhileri: The following test failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name	Commit	Details	Required	Rerun command
ci/prow/e2e-ocp-helm	`e947c1a`	link	true	`/test e2e-ocp-helm`

Full PR test history. Your PR dashboard.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

openshift-ci bot requested review from albarbaro and josephca January 20, 2026 07:22

subhashkhileri temporarily deployed to internal January 20, 2026 07:23 — with GitHub Actions Inactive

christoph-jerolimov reviewed Jan 20, 2026

View reviewed changes

.ibm/pipelines/utils.sh Outdated Show resolved Hide resolved

openshift-ci bot requested review from christoph-jerolimov and jrichter1 January 20, 2026 07:30

openshift-ci bot requested review from HusneShabbir, sanketpathak and teknaS47 January 20, 2026 07:30

subhashkhileri changed the title ~~local test runner~~ chore(e2e) : Add Local Test Runner support for E2E Tests for RHDH core. Jan 20, 2026

subhashkhileri temporarily deployed to internal January 20, 2026 10:13 — with GitHub Actions Inactive

subhashkhileri temporarily deployed to internal January 20, 2026 10:42 — with GitHub Actions Inactive

subhashkhileri temporarily deployed to internal January 20, 2026 11:43 — with GitHub Actions Inactive

gustavolira requested changes Jan 20, 2026

View reviewed changes

subhashkhileri temporarily deployed to internal January 21, 2026 06:22 — with GitHub Actions Inactive

subhashkhileri changed the title ~~chore(e2e) : Add Local Test Runner support for E2E Tests for RHDH core.~~ chore(e2e) : add Local Test Runner support for E2E Tests for RHDH core. Jan 21, 2026

subhashkhileri temporarily deployed to internal January 21, 2026 06:25 — with GitHub Actions Inactive

subhashkhileri force-pushed the local-test-runner branch from 8374063 to 9884207 Compare January 21, 2026 06:30

subhashkhileri temporarily deployed to internal January 21, 2026 06:30 — with GitHub Actions Inactive

subhashkhileri changed the title ~~chore(e2e) : add Local Test Runner support for E2E Tests for RHDH core.~~ chore : add Local Test Runner support for E2E Tests for RHDH core. Jan 21, 2026

subhashkhileri changed the title ~~chore : add Local Test Runner support for E2E Tests for RHDH core.~~ chore: add Local Test Runner support for E2E Tests for RHDH core. Jan 21, 2026

local test runner

810cad6

subhashkhileri force-pushed the local-test-runner branch from 9884207 to 810cad6 Compare January 21, 2026 06:57

subhashkhileri temporarily deployed to internal January 21, 2026 06:57 — with GitHub Actions Inactive

zdrapela reviewed Jan 21, 2026

View reviewed changes

Update .ibm/pipelines/utils.sh

243a9ea

Co-authored-by: Zbyněk Drápela <61500440+zdrapela@users.noreply.github.com>

subhashkhileri temporarily deployed to internal January 22, 2026 04:23 — with GitHub Actions Inactive

subhashkhileri temporarily deployed to internal January 22, 2026 15:56 — with GitHub Actions Inactive

subhashkhileri force-pushed the local-test-runner branch from 8b644ad to 82835ea Compare January 22, 2026 16:00

subhashkhileri temporarily deployed to internal January 22, 2026 16:01 — with GitHub Actions Inactive

zdrapela approved these changes Jan 23, 2026

View reviewed changes

zdrapela reviewed Jan 23, 2026

View reviewed changes

subhashkhileri temporarily deployed to internal January 26, 2026 08:48 — with GitHub Actions Inactive

Merge branch 'main' into local-test-runner

c1433ce

subhashkhileri temporarily deployed to internal January 27, 2026 09:47 — with GitHub Actions Inactive

teknaS47 approved these changes Jan 27, 2026

View reviewed changes

Merge branch 'main' into local-test-runner

e947c1a

subhashkhileri temporarily deployed to internal January 27, 2026 13:47 — with GitHub Actions Inactive

openshift-ci bot assigned zdrapela Jan 27, 2026

openshift-ci bot added the lgtm label Jan 27, 2026

chore: add Local Test Runner support for E2E Tests for RHDH core. #4023

Are you sure you want to change the base?

chore: add Local Test Runner support for E2E Tests for RHDH core. #4023

Conversation

subhashkhileri commented Jan 20, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Description

Which issue(s) does this PR fix

PR acceptance criteria

How to test changes / Special notes to the reviewer

Uh oh!

Uh oh!

christoph-jerolimov commented Jan 20, 2026

Uh oh!

christoph-jerolimov commented Jan 20, 2026

Uh oh!

github-actions bot commented Jan 20, 2026

Uh oh!

github-actions bot commented Jan 20, 2026

Uh oh!

github-actions bot commented Jan 20, 2026

Uh oh!

gustavolira commented Jan 20, 2026

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

zdrapela left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

zdrapela Jan 21, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

github-actions bot commented Jan 22, 2026

Uh oh!

github-actions bot commented Jan 22, 2026

Uh oh!

github-actions bot commented Jan 22, 2026

Uh oh!

zdrapela commented Jan 23, 2026

Uh oh!

rhdh-qodo-merge bot commented Jan 23, 2026

Uh oh!

zdrapela left a comment

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

github-actions bot commented Jan 26, 2026

Uh oh!

github-actions bot commented Jan 27, 2026

Uh oh!

sonarqubecloud bot commented Jan 27, 2026

Quality Gate passed

Uh oh!

zdrapela commented Jan 27, 2026

Uh oh!

openshift-ci bot commented Jan 27, 2026

Uh oh!

subhashkhileri commented Jan 20, 2026 •

edited

Loading

zdrapela Jan 21, 2026 •

edited

Loading