test: Run MultiNetworkPolicy IPv6 test 20 times for failure reproduction by weliang1 · Pull Request #79385 · openshift/release

weliang1 · 2026-05-18T02:56:25Z

Summary

This PR configures the e2e-aws-ovn-dedicated-serial-techpreview periodic job to run a specific MultiNetworkPolicy IPv6 test 20 times to reproduce intermittent failures.

Test Case

[sig-network][Feature:MultiNetworkPolicy][Serial][apigroup:operator.openshift.io] should enforce a network policies on secondary network IPv6

Changes

Added TEST_ARGS environment variable to filter and repeat the test
Uses --run flag to select only the specific test
Uses --count 20 flag to execute 20 iterations

Jobs Affected

periodic-ci-openshift-release-main-nightly-4.22-e2e-aws-ovn-dedicated-serial-techpreview-1of2
periodic-ci-openshift-release-main-nightly-4.22-e2e-aws-ovn-dedicated-serial-techpreview-2of2

Testing

Use /pj-rehearse to validate:

/pj-rehearse periodic-ci-openshift-release-main-nightly-4.22-e2e-aws-ovn-dedicated-serial-techpreview-1of2

This PR modifies the OpenShift 4.22 nightly CI test configuration to help diagnose intermittent failures in the MultiNetworkPolicy IPv6 enforcement test. Specifically, it updates the e2e-aws-ovn-dedicated-serial-techpreview periodic job to run a single targeted test case 20 times repeatedly using the --count 20 flag, rather than running the full test suite.

What's changing in the CI infrastructure:
The job is configured with a new TEST_ARGS environment variable that:

Filters test execution to only the specific MultiNetworkPolicy IPv6 test case ([sig-network][Feature:MultiNetworkPolicy][Serial][apigroup:operator.openshift.io] should enforce a network policies on secondary network IPv6)
Executes 20 iterations of that test to expose any intermittent/flaky behavior

Impact:
Since this periodic job runs on 2 shards (shard_count: 2), this configuration results in 40 total test iterations across both shards, providing sufficient repetitions to reproduce and diagnose failures that may be timing-dependent or occur sporadically.

This is a diagnostic configuration change aimed at improving test reliability for secondary network IPv6 policy enforcement in the TechPreview feature set.

Test case: [sig-network][Feature:MultiNetworkPolicy][Serial][apigroup:operator.openshift.io] should enforce a network policies on secondary network IPv6 Added TEST_ARGS to e2e-aws-ovn-dedicated-serial-techpreview periodic job to: - Filter to only run the specific MultiNetworkPolicy IPv6 test - Execute the test 20 iterations using --count 20 flag This configuration enables reproduction of intermittent failures in the MultiNetworkPolicy IPv6 enforcement test on secondary networks. Job names affected: - periodic-ci-openshift-release-main-nightly-4.22-e2e-aws-ovn-dedicated-serial-techpreview-1of2 - periodic-ci-openshift-release-main-nightly-4.22-e2e-aws-ovn-dedicated-serial-techpreview-2of2 Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com>

openshift-ci · 2026-05-18T02:56:28Z

@weliang1: GitHub didn't allow me to request PR reviews from the following users: weliang1.

Note that only openshift members and repo collaborators can review this PR, and authors cannot review their own PRs.

Details

In response to this:

Summary

This PR configures the e2e-aws-ovn-dedicated-serial-techpreview periodic job to run a specific MultiNetworkPolicy IPv6 test 20 times to reproduce intermittent failures.

Test Case

[sig-network][Feature:MultiNetworkPolicy][Serial][apigroup:operator.openshift.io] should enforce a network policies on secondary network IPv6

Changes

Added TEST_ARGS environment variable to filter and repeat the test

Uses --run flag to select only the specific test

Uses --count 20 flag to execute 20 iterations

Jobs Affected

periodic-ci-openshift-release-main-nightly-4.22-e2e-aws-ovn-dedicated-serial-techpreview-1of2

periodic-ci-openshift-release-main-nightly-4.22-e2e-aws-ovn-dedicated-serial-techpreview-2of2

Testing

Use /pj-rehearse to validate:
/pj-rehearse periodic-ci-openshift-release-main-nightly-4.22-e2e-aws-ovn-dedicated-serial-techpreview-1of2
Related

Reproducing intermittent failure in MultiNetworkPolicy IPv6 enforcement on secondary networks

Each shard will run the test 20 times (40 total iterations across both shards)

/cc @weliang1

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

openshift-ci · 2026-05-18T02:56:50Z

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: weliang1
Once this PR has been reviewed and has the lgtm label, please assign stbenjam for approval. For more information see the Code Review Process.

The full list of commands accepted by this bot can be found here.

Details

Needs approval from an approver in each of these files:

ci-operator/config/openshift/release/OWNERS

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

coderabbitai · 2026-05-18T02:56:53Z

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info

⚙️ Run configuration

Configuration used: Repository YAML (base), Central YAML (inherited)

Review profile: CHILL

Plan: Enterprise

Run ID: 2abbb37a-d891-4e8e-8fa9-5b7086a87933

📥 Commits

Reviewing files that changed from the base of the PR and between 6cf3509 and 616f9f8.

📒 Files selected for processing (1)

ci-operator/config/openshift/release/openshift-release-main__nightly-4.22.yaml

Walkthrough

This PR adds a TEST_ARGS environment variable to the nightly 4.22 CI job configuration, enabling a specific sig-network test selector for MultiNetworkPolicy in Serial mode targeting secondary network IPv6 with 20 iterations.

Changes

CI Job Test Arguments Configuration

Layer / File(s)	Summary
MultiNetworkPolicy serial test configuration `ci-operator/config/openshift/release/openshift-release-main__nightly-4.22.yaml`	Adds `TEST_ARGS` environment variable to run `sig-network` `MultiNetworkPolicy` serial test selector for secondary network IPv6 with `--count 20`.

Estimated code review effort

🎯 1 (Trivial) | ⏱️ ~2 minutes

Suggested labels

rehearsals-ack, lgtm

Suggested reviewers

umohnani8

🚥 Pre-merge checks | ✅ 12

✅ Passed checks (12 passed)

Check name	Status	Explanation
Description Check	✅ Passed	Check skipped - CodeRabbit’s high-level summary is enabled.
Title check	✅ Passed	The title accurately describes the main change: running a MultiNetworkPolicy IPv6 test 20 times to reproduce failures, which aligns with the PR's objective of adding TEST_ARGS to repeat a specific test.
Docstring Coverage	✅ Passed	No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check	✅ Passed	Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check	✅ Passed	Check skipped because no linked issues were found for this pull request.
Stable And Deterministic Test Names	✅ Passed	PR only modifies CI job configuration YAML, not test source code. Custom check applies to Ginkgo test definitions, which are not present in this PR. Test name is static with no dynamic elements.
Test Structure And Quality	✅ Passed	The custom check is for reviewing Ginkgo test code structure and quality. This PR only modifies YAML CI configuration, not test code. The check is not applicable to configuration-only changes.
Microshift Test Compatibility	✅ Passed	Check not applicable: PR only modifies CI configuration (YAML) to run an existing test 20 times. No new Ginkgo e2e tests are added. The custom check only applies when new tests are introduced.
Single Node Openshift (Sno) Test Compatibility	✅ Passed	This PR only modifies CI configuration to run an existing test multiple times. No new Ginkgo e2e tests are added. The SNO compatibility check applies only to newly added tests, not CI changes.
Topology-Aware Scheduling Compatibility	✅ Passed	PR modifies only CI test configuration (TEST_ARGS for network test), not deployment manifests or operator code. No scheduling constraints introduced.
Ote Binary Stdout Contract	✅ Passed	PR adds test output conversion utilities (gotest2junit, junitreport) that intentionally write XML to stdout. These are not OTE binaries. OTE contract applies only to test execution binaries.
Ipv6 And Disconnected Network Test Compatibility	✅ Passed	No new Ginkgo e2e tests are added. Changes are CI configuration only (YAML) to run an existing test 20 times. The custom check applies only when new test code is added.

_{✏️ Tip: You can configure your own custom pre-merge checks in the settings.}

✨ Finishing Touches

🧪 Generate unit tests (beta)

Create PR with unit tests

_{Comment @coderabbitai help to get the list of available commands and usage tips.}

weliang1 · 2026-05-18T02:57:11Z

/pj-rehearse periodic-ci-openshift-release-main-nightly-4.22-e2e-aws-ovn-dedicated-serial-techpreview-1of2

openshift-merge-bot · 2026-05-18T02:59:26Z

[REHEARSALNOTIFIER]
@weliang1: no rehearsable tests are affected by this change

Note: If this PR includes changes to step registry files (ci-operator/step-registry/) and you expected jobs to be found, try rebasing your PR onto the base branch. This helps pj-rehearse accurately detect changes when the base branch has moved forward.

openshift-merge-bot · 2026-05-18T02:59:26Z

@weliang1: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel.

openshift-ci · 2026-05-18T03:01:20Z

@weliang1: all tests passed!

Full PR test history. Your PR dashboard.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

openshift-merge-bot · 2026-05-18T03:02:38Z

@weliang1: job(s): periodic-ci-openshift-release-main-nightly-4.22-e2e-aws-ovn-dedicated-serial-techpreview-1of2 either don't exist or were not found to be affected, and cannot be rehearsed

openshift-merge-bot Bot added the rehearsals-ack Signifies that rehearsal jobs have been acknowledged label May 18, 2026

weliang1 closed this May 18, 2026

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

test: Run MultiNetworkPolicy IPv6 test 20 times for failure reproduction#79385

test: Run MultiNetworkPolicy IPv6 test 20 times for failure reproduction#79385
weliang1 wants to merge 1 commit into
openshift:mainfrom
weliang1:test-multinetworkpolicy-ipv6-20x

weliang1 commented May 18, 2026 •

edited by coderabbitai Bot

Loading

Uh oh!

openshift-ci Bot commented May 18, 2026

Summary

Test Case

Changes

Jobs Affected

Testing

Related

Uh oh!

openshift-ci Bot commented May 18, 2026

Uh oh!

coderabbitai Bot commented May 18, 2026 •

edited

Loading

Uh oh!

weliang1 commented May 18, 2026

Uh oh!

openshift-merge-bot Bot commented May 18, 2026

Uh oh!

openshift-merge-bot Bot commented May 18, 2026

Uh oh!

openshift-ci Bot commented May 18, 2026

Uh oh!

openshift-merge-bot Bot commented May 18, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

Conversation

weliang1 commented May 18, 2026 • edited by coderabbitai Bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Summary

Test Case

Changes

Jobs Affected

Testing

Related

Uh oh!

openshift-ci Bot commented May 18, 2026

Summary

Test Case

Changes

Jobs Affected

Testing

Related

Uh oh!

openshift-ci Bot commented May 18, 2026

Uh oh!

coderabbitai Bot commented May 18, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Walkthrough

Changes

Estimated code review effort

Suggested labels

Suggested reviewers

Uh oh!

weliang1 commented May 18, 2026

Uh oh!

openshift-merge-bot Bot commented May 18, 2026

Uh oh!

openshift-merge-bot Bot commented May 18, 2026

Uh oh!

openshift-ci Bot commented May 18, 2026

Uh oh!

openshift-merge-bot Bot commented May 18, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

weliang1 commented May 18, 2026 •

edited by coderabbitai Bot

Loading

coderabbitai Bot commented May 18, 2026 •

edited

Loading