NO-ISSUE: Automated - Update synthetic test data

[openshift-bot]

disruptions Information

There were (56) added jobs and (272) were removed.

Comparisons were above allowed leeway of 30.00%

Note: For P99, disruptions had 263 jobs increased and 1466 jobs decreased.

Click To Show Table

Name	Release	From	Arch	Network	Platform	Topology	Job Results	P95	P95 % Increase	P99	P99 % Increase
kube-api-http1-localhost-new-connections	4.22	4.22	amd64	ovn	azure	ha	845	1m15s	38.38%	1m30s	64.11%
cache-oauth-api-new-connections	4.22	4.22	amd64	ovn	metal	ha	109	12s	1100.00%	16.76s	586.89%
ingress-to-console-new-connections	5.0		ppc64le	ovn	libvirt	ha	146	11.5s	1252.94%	4m20s	26704.12%
kube-api-http1-internal-lb-reused-connections	5.0	5.0	amd64	ovn	vsphere	ha	107	6s	106.90%	12.76s	103.51%
cache-kube-api-new-connections	5.0		ppc64le	ovn	libvirt	ha	147	4s	116.22%	4m2.28s	12198.48%
openshift-api-http2-internal-lb-new-connections	4.22	4.22	amd64	ovn	vsphere	ha	112	4.35s	64.15%	10s	44.30%
kube-api-http2-internal-lb-new-connections	5.0	5.0	amd64	ovn	vsphere	ha	107	6s	37.93%	12.88s	40.31%
kube-api-http1-internal-lb-new-connections	5.0	5.0	amd64	ovn	vsphere	ha	107	6s	37.93%	12.88s	40.31%
kube-api-http2-service-network-new-connections	4.22	4.22	amd64	ovn	azure	ha	845	6s	30.43%	8s	62.60%
oauth-api-reused-connections	5.0	5.0	amd64	ovn	vsphere	ha	107	2.7s	86.21%	8.82s	38.68%
cache-oauth-api-new-connections	4.22		ppc64le	ovn	none	ha	186	3.75s	38.89%	5.15s	37.70%
kube-api-reused-connections	5.0	5.0	amd64	ovn	vsphere	ha	107	2s	100.00%	5.94s	81.65%
service-load-balancer-with-pdb-new-connections	5.0	5.0	amd64	ovn	gcp	ha	1194	2s	100.00%	3.07s	207.00%
openshift-api-http2-internal-lb-new-connections	5.0	4.22	amd64	ovn	vsphere	ha	101	2s	100.00%	3s	39.53%
openshift-api-http2-internal-lb-reused-connections	5.0	4.22	amd64	ovn	vsphere	ha	101	2s	100.00%	3s	39.53%
oauth-api-reused-connections	5.0	5.0	amd64	ovn	metal	ha	103	2.9s	45.00%	9.94s	98.80%
image-registry-new-connections	4.22	4.22	multi	ovn	aws	ha	123	1s	566.67%	3.78s	33.57%
kube-api-new-connections	5.0	5.0	amd64	ovn	vsphere	ha	107	2.7s	35.00%	8.82s	40.67%
cache-openshift-api-reused-connections	5.0	5.0	amd64	ovn	vsphere	ha	107	2.7s	35.00%	8.82s	38.68%
cache-kube-api-reused-connections	5.0	5.0	amd64	ovn	vsphere	ha	107	2s	37.93%	5.94s	81.65%
image-registry-new-connections	5.0		multi	ovn	aws	ha	190	550ms	57.14%	7.1s	382.99%
kube-api-http1-service-network-reused-connections	4.22	4.22	amd64	ovn	azure	ha	845	1s	0.00%	2s	104.08%
kube-api-http1-internal-lb-reused-connections	4.22		amd64	ovn	aws	ha	184	0s	0.00%	1s	53.85%
pod-to-service-new-connections	4.22		amd64	ovn	aws	ha	183	0s	0.00%	1s	51.52%
cache-oauth-api-reused-connections	4.22		amd64	ovn	aws	single	112	56s	0.00%	1m54.07s	89.49%
oauth-api-reused-connections	4.22	4.21	amd64	ovn	azure	ha	1106	2s	0.00%	5.95s	48.75%
cache-kube-api-reused-connections	4.22		amd64	ovn	aws	single	112	56s	0.00%	1m54.07s	89.49%
openshift-api-http2-internal-lb-reused-connections	4.22	4.22	amd64	ovn	metal	ha	108	12.95s	0.00%	18.93s	33.12%
pod-to-service-new-connections	4.22	4.22	amd64	ovn	aws	single	823	2s	0.00%	16.34s	81.56%
host-to-pod-new-connections	4.22		s390x	ovn	none	ha	151	0s	0.00%	500ms	163.16%
cache-openshift-api-reused-connections	4.22		amd64	ovn	aws	single	112	56s	0.00%	1m54.07s	89.49%
pod-to-pod-new-connections	4.22		s390x	ovn	none	ha	151	0s	0.00%	500ms	163.16%
ci-cluster-network-liveness-new-connections	4.22		amd64	ovn	gcp	ha	436	1s	0.00%	21.4s	93.67%
openshift-api-http2-internal-lb-new-connections	4.22		amd64	ovn	gcp	ha	436	1s	0.00%	9s	800.00%
cache-kube-api-reused-connections	4.22	4.22	amd64	ovn	azure	ha	845	1s	0.00%	2s	104.08%
ci-cluster-network-liveness-new-connections	4.22		s390x	ovn	none	ha	151	0s	0.00%	10m50s	48.50%
openshift-api-new-connections	4.22		s390x	ovn	none	ha	151	0s	0.00%	10m50.5s	48.32%
host-to-service-reused-connections	4.22	4.22	amd64	ovn	aws	single	823	0s	0.00%	24.56s	66.62%
ci-cluster-network-liveness-new-connections	4.22		amd64	ovn	aws	microshift	223	0s	0.00%	25.9s	46.33%
openshift-api-http2-service-network-new-connections	4.22	4.22	amd64	ovn	vsphere	ha	112	0s	0.00%	42.37s	47.07%
ingress-to-console-new-connections	4.22	4.22	amd64	ovn	aws	ha	969	3s	0.00%	6.32s	62.89%
host-to-service-new-connections	4.22	4.22	amd64	ovn	aws	single	823	0s	0.00%	24.56s	65.16%
ingress-to-console-new-connections	4.22	4.22	amd64	ovn	gcp	ha	1180	2s	0.00%	4s	103.05%
service-load-balancer-with-pdb-new-connections	4.22		amd64	ovn	gcp	ha	436	0s	0.00%	1.65s	65.00%
cache-oauth-api-new-connections	4.22	4.22	amd64	ovn	gcp	ha	1180	0s	0.00%	4s	106.19%
pod-to-service-reused-connections	4.22	4.22	amd64	ovn	aws	single	823	2s	0.00%	16.34s	81.56%
azure-network-liveness-new-connections	4.22	4.21	amd64	ovn	gcp	ha	869	0s	0.00%	33.6s	110.66%
cache-kube-api-new-connections	4.22	4.22	amd64	ovn	gcp	ha	1180	0s	0.00%	4s	300.00%
ingress-to-console-new-connections	4.22	4.22	multi	ovn	aws	ha	123	1s	0.00%	3.78s	33.57%
oauth-api-new-connections	4.22	4.22	amd64	ovn	vsphere	ha	112	2s	0.00%	21.13s	55.60%
kube-api-new-connections	4.22	4.22	amd64	ovn	gcp	ha	1180	0s	0.00%	4s	105.13%
kube-api-http1-service-network-new-connections	4.22	4.22	amd64	ovn	azure	ha	845	6s	0.00%	8s	60.64%
kube-api-http1-localhost-new-connections	4.22	4.22	amd64	ovn	aws	ha	969	59s	0.00%	1m13.32s	53.52%
oauth-api-new-connections	4.22		s390x	ovn	none	ha	151	500ms	0.00%	10m50.5s	178.35%
aws-network-liveness-new-connections	4.22	4.21	amd64	ovn	azure	ha	1106	0s	0.00%	1.95s	95.00%
cache-openshift-api-new-connections	4.22		amd64	ovn	gcp	ha	124	0s	0.00%	3.31s	231.00%
image-registry-new-connections	4.22		amd64	ovn	gcp	ha	436	1s	0.00%	6.65s	565.00%
cache-openshift-api-new-connections	4.22	4.22	amd64	ovn	vsphere	ha	112	2.45s	0.00%	11.34s	44.27%
ingress-to-console-new-connections	4.22		amd64	ovn	gcp	ha	124	1s	0.00%	1.77s	77.00%
openshift-api-http2-service-network-reused-connections	4.22		amd64	ovn	aws	ha	108	0s	0.00%	930ms	45.31%
kube-api-new-connections	4.22		s390x	ovn	none	ha	151	0s	0.00%	10m50.5s	48.32%
ingress-to-oauth-server-new-connections	4.22	4.22	multi	ovn	aws	ha	123	1s	0.00%	3.56s	78.00%
metrics-api-new-connections	4.22	4.22	amd64	ovn	gcp	ha	1180	0s	0.00%	3.21s	60.50%
kube-api-http1-localhost-reused-connections	4.22	4.22	amd64	ovn	aws	ha	969	59s	0.00%	1m13s	52.98%
ingress-to-console-reused-connections	4.22	4.22	multi	ovn	aws	ha	123	0s	0.00%	2.56s	208.43%
openshift-api-http2-localhost-new-connections	5.0		amd64	ovn	gcp	ha	427	1m31s	0.00%	1m38.74s	1902.84%
oauth-api-new-connections	5.0	4.22	amd64	ovn	gcp	ha	866	0s	0.00%	2s	100.00%
openshift-api-http2-service-network-reused-connections	5.0	5.0	amd64	ovn	aws	ha	877	1s	0.00%	49.72s	63.34%
cache-kube-api-new-connections	5.0		amd64	ovn	gcp	ha	111	0s	0.00%	1s	194.12%
oauth-api-new-connections	5.0	5.0	amd64	ovn	aws	ha	877	2s	0.00%	29s	88.31%
cache-kube-api-reused-connections	5.0	5.0	amd64	ovn	azure	ha	797	1s	0.00%	2s	100.00%
cache-kube-api-new-connections	5.0	5.0	amd64	ovn	aws	ha	877	0s	0.00%	7s	250.00%
kube-api-http2-localhost-new-connections	5.0	5.0	amd64	ovn	aws	ha	877	1m2s	0.00%	1m23.24s	55.30%
openshift-api-http2-localhost-new-connections	5.0	5.0	amd64	ovn	aws	ha	877	1m12s	0.00%	1m55.68s	94.09%
pod-to-pod-reused-connections	5.0	4.22	amd64	ovn	vsphere	ha	101	0s	0.00%	1m3s	172.73%
openshift-api-http2-service-network-reused-connections	5.0	5.0	amd64	ovn	metal	ha	103	2.8s	0.00%	19.92s	564.00%
metrics-api-new-connections	5.0	4.22	amd64	ovn	vsphere	ha	101	1s	0.00%	2s	73.91%
kube-api-http1-service-network-reused-connections	5.0	5.0	amd64	ovn	metal	ha	103	0s	0.00%	980ms	553.33%
openshift-api-http2-localhost-reused-connections	5.0		amd64	ovn	gcp	ha	427	1m33s	0.00%	1m39.48s	1917.85%
openshift-api-new-connections	5.0		ppc64le	ovn	libvirt	ha	147	4s	0.00%	3m59.2s	3407.33%
ingress-to-console-new-connections	5.0		amd64	ovn	gcp	ha	426	1s	0.00%	2s	70.94%
kube-api-http1-service-network-new-connections	5.0	5.0	amd64	ovn	aws	ha	877	0s	0.00%	17.24s	155.03%
image-registry-new-connections	5.0		amd64	ovn	gcp	ha	426	1s	0.00%	2s	100.00%
pod-to-pod-new-connections	5.0	4.22	amd64	ovn	vsphere	ha	101	0s	0.00%	2m13s	475.76%
kube-api-http1-localhost-new-connections	5.0		amd64	ovn	gcp	ha	111	33s	0.00%	1m12.7s	3189.59%
kube-api-new-connections	5.0	4.22	amd64	ovn	gcp	ha	866	0s	0.00%	2s	100.00%
openshift-api-new-connections	5.0	5.0	amd64	ovn	azure	ha	797	0s	0.00%	4s	100.00%
cache-openshift-api-new-connections	5.0	5.0	amd64	ovn	azure	ha	797	0s	0.00%	2s	100.00%
host-to-pod-new-connections	5.0	4.22	amd64	ovn	vsphere	ha	101	0s	0.00%	2m8s	450.54%
openshift-api-http2-service-network-reused-connections	5.0	4.22	amd64	ovn	vsphere	ha	101	1s	0.00%	2s	73.91%
metrics-api-reused-connections	5.0	4.22	amd64	ovn	vsphere	ha	101	1s	0.00%	2s	73.91%
host-to-host-reused-connections	5.0	4.22	amd64	ovn	vsphere	ha	101	0s	0.00%	2m34s	566.67%
pod-to-service-new-connections	5.0	4.22	amd64	ovn	vsphere	ha	101	0s	0.00%	27s	451.02%
cache-openshift-api-new-connections	5.0		ppc64le	ovn	libvirt	ha	147	4s	0.00%	4m0.2s	2971.61%
ingress-to-oauth-server-new-connections	5.0		ppc64le	ovn	libvirt	ha	146	4s	0.00%	4m5.7s	3589.19%
pod-to-pod-reused-connections	5.0	4.22	amd64	ovn	azure	ha	1094	0s	0.00%	3s	50.00%
pod-to-host-new-connections	5.0	4.22	amd64	ovn	vsphere	ha	101	0s	0.00%	2m34s	566.67%
openshift-api-http2-service-network-new-connections	5.0	4.22	amd64	ovn	vsphere	ha	101	0s	0.00%	2s	1233.33%
host-to-service-new-connections	5.0	4.22	amd64	ovn	vsphere	ha	101	0s	0.00%	25s	380.77%
host-to-host-new-connections	5.0	4.22	amd64	ovn	gcp	ha	866	0s	0.00%	1s	2400.00%
metrics-api-reused-connections	5.0		ppc64le	ovn	libvirt	ha	147	0s	0.00%	2.08s	153.66%
openshift-api-http2-service-network-reused-connections	5.0		multi	ovn	aws	ha	190	0s	0.00%	1s	112.77%
host-to-host-new-connections	5.0	4.22	amd64	ovn	vsphere	ha	101	0s	0.00%	2m34s	566.67%
openshift-api-reused-connections	5.0	5.0	amd64	ovn	azure	ha	797	1s	0.00%	2s	106.19%
ingress-to-oauth-server-new-connections	5.0		multi	ovn	aws	ha	190	0s	0.00%	1.55s	55.00%
ingress-to-console-reused-connections	5.0	4.22	amd64	ovn	vsphere	ha	101	0s	0.00%	1s	566.67%
metrics-api-new-connections	5.0	5.0	amd64	ovn	azure	ha	797	0s	0.00%	3s	512.24%
pod-to-host-new-connections	5.0	5.0	amd64	ovn	azure	ha	797	0s	0.00%	3.08s	208.00%
cache-oauth-api-reused-connections	5.0	5.0	amd64	ovn	aws	ha	877	0s	0.00%	4.92s	70.83%
openshift-api-http2-localhost-reused-connections	5.0	5.0	amd64	ovn	aws	ha	877	1m13s	0.00%	1m58s	97.85%
oauth-api-new-connections	5.0		ppc64le	ovn	libvirt	ha	147	4s	0.00%	3m59.66s	3036.91%
pod-to-host-reused-connections	5.0	4.22	amd64	ovn	vsphere	ha	101	0s	0.00%	2m34s	566.67%
host-to-host-new-connections	5.0	5.0	amd64	ovn	azure	ha	797	0s	0.00%	4s	300.00%
host-to-pod-reused-connections	5.0	5.0	amd64	ovn	aws	ha	877	0s	0.00%	1.48s	48.00%
host-to-pod-reused-connections	5.0	4.22	amd64	ovn	vsphere	ha	101	0s	0.00%	1m3s	172.73%
metrics-api-new-connections	5.0		ppc64le	ovn	libvirt	ha	147	4s	0.00%	4m0.74s	3051.05%
ci-cluster-network-liveness-new-connections	5.0	5.0	amd64	ovn	azure	ha	797	0s	0.00%	6s	308.16%
service-load-balancer-with-pdb-new-connections	5.0		amd64	ovn	gcp	ha	111	0s	0.00%	900ms	164.71%
cache-oauth-api-new-connections	5.0		ppc64le	ovn	libvirt	ha	147	4s	0.00%	4m0.74s	3051.05%

alerts Information

There were (2852) added jobs and (15168) were removed.

Comparisons were above allowed leeway of 30.00%

Note: For P99, alerts had 69 jobs increased and 495 jobs decreased.

Click To Show Table

Name	Release	From	Arch	Network	Platform	Topology	Job Results	P95	P95 % Increase	P99	P99 % Increase
NodeSystemSaturation openshift-monitoring Warning	5.0	5.0	amd64	ovn	azure	ha	245	8m28s	188.64%	25m28.32s	200.85%
HighOverallControlPlaneCPU openshift-kube-apiserver Warning	4.22	4.22	amd64	ovn	gcp	ha	248	3m56s	742.86%	14m29.8s	139.92%
HighOverallControlPlaneCPU openshift-kube-apiserver Warning	4.22	4.21	amd64	ovn	gcp	ha	171	2m56s	188.52%	13m46s	158.67%
ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning	4.22		amd64	ovn	azure	ha	155	2m28s	83.85%	7m9.4s	46.35%
ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning	4.22		arm64	ovn	aws	ha	114	1m28s	152.87%	2m58s	62.41%
TestAlertFeatureE2ETestOTA1813 openshift-cluster-version Critical	5.0		amd64	ovn	azure	ha	155	1m3.2s	81.61%	1m42.6s	43.62%
HighOverallControlPlaneCPU openshift-kube-apiserver Warning	4.22		amd64	ovn	aws	ha	410	28s	233.33%	5m19.72s	90.45%
etcdDatabaseHighFragmentationRatio openshift-etcd Warning	4.22	4.22	amd64	ovn	gcp	ha	248	0s	0.00%	3m55.8s	60.87%
etcdGRPCRequestsSlow openshift-etcd Critical	4.22	4.21	amd64	ovn	azure	ha	241	0s	0.00%	1m46s	82.76%
CannotRetrieveUpdates openshift-cluster-version Warning	4.22		amd64	ovn	gcp	ha	177	2m46s	0.00%	11m48.4s	38.14%
CannotRetrieveUpdates openshift-cluster-version Warning	4.22		amd64	ovn	vsphere	ha	271	1m28s	0.00%	4m46s	60.67%
PodDisruptionBudgetAtLimit openshift-kube-controller-manager Warning	4.22		amd64	ovn	metal	ha	313	0s	0.00%	12m19.04s	73.09%
KubeJobFailed openshift-insights Warning	4.22		arm64	ovn	aws	ha	114	1h56m32.6s	0.00%	4h25m59.04s	122.00%
PodDisruptionBudgetAtLimit openshift-kube-scheduler Warning	4.22		amd64	ovn	metal	ha	313	0s	0.00%	12m19.04s	77.45%
HighOverallControlPlaneCPU openshift-kube-apiserver Warning	4.22		arm64	ovn	aws	ha	114	9.8s	0.00%	56s	100.00%
PodDisruptionBudgetAtLimit openshift-apiserver Warning	4.22		amd64	ovn	metal	ha	313	0s	0.00%	12m15.44s	76.58%
PodDisruptionBudgetAtLimit openshift-oauth-apiserver Warning	4.22		amd64	ovn	metal	ha	313	0s	0.00%	12m19.04s	77.45%
PodDisruptionBudgetAtLimit openshift-kube-apiserver Warning	4.22		amd64	ovn	metal	ha	313	0s	0.00%	12m15.44s	76.58%
PodDisruptionBudgetAtLimit openshift-etcd Warning	4.22		amd64	ovn	metal	ha	313	0s	0.00%	12m19.04s	77.45%
KubeletPlegDurationHigh kube-system Warning	5.0	5.0	amd64	ovn	azure	ha	245	3m28s	0.00%	7m3.2s	42.01%
TestAlertFeatureE2ETestOTA1813 openshift-cluster-version Critical	5.0		amd64	ovn	aws	single	117	1m8s	0.00%	2m3.04s	54.65%
TechPreviewNoUpgrade openshift-kube-apiserver-operator Warning	5.0		amd64	ovn	gcp	ha	181	1h55m0s	0.00%	3h55m3.6s	106.96%
NodeSystemSaturation openshift-monitoring Warning	5.0	5.0	amd64	ovn	aws	ha	276	9m33.5s	0.00%	25m41.5s	72.04%
HighOverallControlPlaneCPU openshift-kube-apiserver Warning	5.0		arm64	ovn	aws	ha	130	0s	0.00%	19.88s	3450.00%
IngressControllerDegraded openshift-ingress-operator Warning	5.0		amd64	ovn	metal	ha	341	0s	0.00%	2m34s	450.00%
MachineWithNoRunningPhase openshift-machine-api Warning	5.0	4.22	amd64	ovn	azure	ha	261	0s	0.00%	32m57.2s	98.72%
HighOverallControlPlaneCPU openshift-kube-apiserver Warning	5.0	5.0	amd64	ovn	aws	ha	276	58s	0.00%	4m19s	54.57%
TestAlertFeatureE2ETestOTA1813 openshift-cluster-version Critical	5.0		amd64	ovn	vsphere	ha	291	1m5s	0.00%	1m54.8s	64.85%
ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning	5.0		amd64	ovn	vsphere	ha	291	0s	0.00%	1m0.8s	54.00%
NodeSystemSaturation openshift-monitoring Warning	5.0		arm64	ovn	aws	ha	130	9m14.5s	0.00%	28m5.38s	66.64%
ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning	5.0	5.0	amd64	ovn	gcp	ha	271	1m28s	0.00%	5m43.4s	48.02%
ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning	5.0		arm64	ovn	aws	ha	130	0s	0.00%	2m1.32s	36.93%

/cc @xueqzhan, @neisw, @smg247

[openshift-merge-bot]

Pipeline controller notification
This repo is configured to use the pipeline controller. Second-stage tests will be triggered either automatically or after lgtm label is added, depending on the repository configuration. The pipeline controller will automatically detect which contexts are required and will utilize /test Prow commands to trigger the second stage.

For optional jobs, comment /test ? to see a list of all defined jobs. To trigger manually all jobs from second stage use /pipeline required command.

This repository is configured in: automatic mode

[openshift-ci-robot]

@openshift-bot: This pull request explicitly references no jira issue.

Details

In response to this:

disruptions Information

There were (56) added jobs and (272) were removed.

Comparisons were above allowed leeway of 30.00%

Note: For P99, disruptions had 263 jobs increased and 1466 jobs decreased.

Click To Show Table

Name	Release	From	Arch	Network	Platform	Topology	Job Results	P95	P95 % Increase	P99	P99 % Increase
kube-api-http1-localhost-new-connections	4.22	4.22	amd64	ovn	azure	ha	845	1m15s	38.38%	1m30s	64.11%
cache-oauth-api-new-connections	4.22	4.22	amd64	ovn	metal	ha	109	12s	1100.00%	16.76s	586.89%
ingress-to-console-new-connections	5.0		ppc64le	ovn	libvirt	ha	146	11.5s	1252.94%	4m20s	26704.12%
kube-api-http1-internal-lb-reused-connections	5.0	5.0	amd64	ovn	vsphere	ha	107	6s	106.90%	12.76s	103.51%
cache-kube-api-new-connections	5.0		ppc64le	ovn	libvirt	ha	147	4s	116.22%	4m2.28s	12198.48%
openshift-api-http2-internal-lb-new-connections	4.22	4.22	amd64	ovn	vsphere	ha	112	4.35s	64.15%	10s	44.30%
kube-api-http2-internal-lb-new-connections	5.0	5.0	amd64	ovn	vsphere	ha	107	6s	37.93%	12.88s	40.31%
kube-api-http1-internal-lb-new-connections	5.0	5.0	amd64	ovn	vsphere	ha	107	6s	37.93%	12.88s	40.31%
kube-api-http2-service-network-new-connections	4.22	4.22	amd64	ovn	azure	ha	845	6s	30.43%	8s	62.60%
oauth-api-reused-connections	5.0	5.0	amd64	ovn	vsphere	ha	107	2.7s	86.21%	8.82s	38.68%
cache-oauth-api-new-connections	4.22		ppc64le	ovn	none	ha	186	3.75s	38.89%	5.15s	37.70%
kube-api-reused-connections	5.0	5.0	amd64	ovn	vsphere	ha	107	2s	100.00%	5.94s	81.65%
service-load-balancer-with-pdb-new-connections	5.0	5.0	amd64	ovn	gcp	ha	1194	2s	100.00%	3.07s	207.00%
openshift-api-http2-internal-lb-new-connections	5.0	4.22	amd64	ovn	vsphere	ha	101	2s	100.00%	3s	39.53%
openshift-api-http2-internal-lb-reused-connections	5.0	4.22	amd64	ovn	vsphere	ha	101	2s	100.00%	3s	39.53%
oauth-api-reused-connections	5.0	5.0	amd64	ovn	metal	ha	103	2.9s	45.00%	9.94s	98.80%
image-registry-new-connections	4.22	4.22	multi	ovn	aws	ha	123	1s	566.67%	3.78s	33.57%
kube-api-new-connections	5.0	5.0	amd64	ovn	vsphere	ha	107	2.7s	35.00%	8.82s	40.67%
cache-openshift-api-reused-connections	5.0	5.0	amd64	ovn	vsphere	ha	107	2.7s	35.00%	8.82s	38.68%
cache-kube-api-reused-connections	5.0	5.0	amd64	ovn	vsphere	ha	107	2s	37.93%	5.94s	81.65%
image-registry-new-connections	5.0		multi	ovn	aws	ha	190	550ms	57.14%	7.1s	382.99%
kube-api-http1-service-network-reused-connections	4.22	4.22	amd64	ovn	azure	ha	845	1s	0.00%	2s	104.08%
kube-api-http1-internal-lb-reused-connections	4.22		amd64	ovn	aws	ha	184	0s	0.00%	1s	53.85%
pod-to-service-new-connections	4.22		amd64	ovn	aws	ha	183	0s	0.00%	1s	51.52%
cache-oauth-api-reused-connections	4.22		amd64	ovn	aws	single	112	56s	0.00%	1m54.07s	89.49%
oauth-api-reused-connections	4.22	4.21	amd64	ovn	azure	ha	1106	2s	0.00%	5.95s	48.75%
cache-kube-api-reused-connections	4.22		amd64	ovn	aws	single	112	56s	0.00%	1m54.07s	89.49%
openshift-api-http2-internal-lb-reused-connections	4.22	4.22	amd64	ovn	metal	ha	108	12.95s	0.00%	18.93s	33.12%
pod-to-service-new-connections	4.22	4.22	amd64	ovn	aws	single	823	2s	0.00%	16.34s	81.56%
host-to-pod-new-connections	4.22		s390x	ovn	none	ha	151	0s	0.00%	500ms	163.16%
cache-openshift-api-reused-connections	4.22		amd64	ovn	aws	single	112	56s	0.00%	1m54.07s	89.49%
pod-to-pod-new-connections	4.22		s390x	ovn	none	ha	151	0s	0.00%	500ms	163.16%
ci-cluster-network-liveness-new-connections	4.22		amd64	ovn	gcp	ha	436	1s	0.00%	21.4s	93.67%
openshift-api-http2-internal-lb-new-connections	4.22		amd64	ovn	gcp	ha	436	1s	0.00%	9s	800.00%
cache-kube-api-reused-connections	4.22	4.22	amd64	ovn	azure	ha	845	1s	0.00%	2s	104.08%
ci-cluster-network-liveness-new-connections	4.22		s390x	ovn	none	ha	151	0s	0.00%	10m50s	48.50%
openshift-api-new-connections	4.22		s390x	ovn	none	ha	151	0s	0.00%	10m50.5s	48.32%
host-to-service-reused-connections	4.22	4.22	amd64	ovn	aws	single	823	0s	0.00%	24.56s	66.62%
ci-cluster-network-liveness-new-connections	4.22		amd64	ovn	aws	microshift	223	0s	0.00%	25.9s	46.33%
openshift-api-http2-service-network-new-connections	4.22	4.22	amd64	ovn	vsphere	ha	112	0s	0.00%	42.37s	47.07%
ingress-to-console-new-connections	4.22	4.22	amd64	ovn	aws	ha	969	3s	0.00%	6.32s	62.89%
host-to-service-new-connections	4.22	4.22	amd64	ovn	aws	single	823	0s	0.00%	24.56s	65.16%
ingress-to-console-new-connections	4.22	4.22	amd64	ovn	gcp	ha	1180	2s	0.00%	4s	103.05%
service-load-balancer-with-pdb-new-connections	4.22		amd64	ovn	gcp	ha	436	0s	0.00%	1.65s	65.00%
cache-oauth-api-new-connections	4.22	4.22	amd64	ovn	gcp	ha	1180	0s	0.00%	4s	106.19%
pod-to-service-reused-connections	4.22	4.22	amd64	ovn	aws	single	823	2s	0.00%	16.34s	81.56%
azure-network-liveness-new-connections	4.22	4.21	amd64	ovn	gcp	ha	869	0s	0.00%	33.6s	110.66%
cache-kube-api-new-connections	4.22	4.22	amd64	ovn	gcp	ha	1180	0s	0.00%	4s	300.00%
ingress-to-console-new-connections	4.22	4.22	multi	ovn	aws	ha	123	1s	0.00%	3.78s	33.57%
oauth-api-new-connections	4.22	4.22	amd64	ovn	vsphere	ha	112	2s	0.00%	21.13s	55.60%
kube-api-new-connections	4.22	4.22	amd64	ovn	gcp	ha	1180	0s	0.00%	4s	105.13%
kube-api-http1-service-network-new-connections	4.22	4.22	amd64	ovn	azure	ha	845	6s	0.00%	8s	60.64%
kube-api-http1-localhost-new-connections	4.22	4.22	amd64	ovn	aws	ha	969	59s	0.00%	1m13.32s	53.52%
oauth-api-new-connections	4.22		s390x	ovn	none	ha	151	500ms	0.00%	10m50.5s	178.35%
aws-network-liveness-new-connections	4.22	4.21	amd64	ovn	azure	ha	1106	0s	0.00%	1.95s	95.00%
cache-openshift-api-new-connections	4.22		amd64	ovn	gcp	ha	124	0s	0.00%	3.31s	231.00%
image-registry-new-connections	4.22		amd64	ovn	gcp	ha	436	1s	0.00%	6.65s	565.00%
cache-openshift-api-new-connections	4.22	4.22	amd64	ovn	vsphere	ha	112	2.45s	0.00%	11.34s	44.27%
ingress-to-console-new-connections	4.22		amd64	ovn	gcp	ha	124	1s	0.00%	1.77s	77.00%
openshift-api-http2-service-network-reused-connections	4.22		amd64	ovn	aws	ha	108	0s	0.00%	930ms	45.31%
kube-api-new-connections	4.22		s390x	ovn	none	ha	151	0s	0.00%	10m50.5s	48.32%
ingress-to-oauth-server-new-connections	4.22	4.22	multi	ovn	aws	ha	123	1s	0.00%	3.56s	78.00%
metrics-api-new-connections	4.22	4.22	amd64	ovn	gcp	ha	1180	0s	0.00%	3.21s	60.50%
kube-api-http1-localhost-reused-connections	4.22	4.22	amd64	ovn	aws	ha	969	59s	0.00%	1m13s	52.98%
ingress-to-console-reused-connections	4.22	4.22	multi	ovn	aws	ha	123	0s	0.00%	2.56s	208.43%
openshift-api-http2-localhost-new-connections	5.0		amd64	ovn	gcp	ha	427	1m31s	0.00%	1m38.74s	1902.84%
oauth-api-new-connections	5.0	4.22	amd64	ovn	gcp	ha	866	0s	0.00%	2s	100.00%
openshift-api-http2-service-network-reused-connections	5.0	5.0	amd64	ovn	aws	ha	877	1s	0.00%	49.72s	63.34%
cache-kube-api-new-connections	5.0		amd64	ovn	gcp	ha	111	0s	0.00%	1s	194.12%
oauth-api-new-connections	5.0	5.0	amd64	ovn	aws	ha	877	2s	0.00%	29s	88.31%
cache-kube-api-reused-connections	5.0	5.0	amd64	ovn	azure	ha	797	1s	0.00%	2s	100.00%
cache-kube-api-new-connections	5.0	5.0	amd64	ovn	aws	ha	877	0s	0.00%	7s	250.00%
kube-api-http2-localhost-new-connections	5.0	5.0	amd64	ovn	aws	ha	877	1m2s	0.00%	1m23.24s	55.30%
openshift-api-http2-localhost-new-connections	5.0	5.0	amd64	ovn	aws	ha	877	1m12s	0.00%	1m55.68s	94.09%
pod-to-pod-reused-connections	5.0	4.22	amd64	ovn	vsphere	ha	101	0s	0.00%	1m3s	172.73%
openshift-api-http2-service-network-reused-connections	5.0	5.0	amd64	ovn	metal	ha	103	2.8s	0.00%	19.92s	564.00%
metrics-api-new-connections	5.0	4.22	amd64	ovn	vsphere	ha	101	1s	0.00%	2s	73.91%
kube-api-http1-service-network-reused-connections	5.0	5.0	amd64	ovn	metal	ha	103	0s	0.00%	980ms	553.33%
openshift-api-http2-localhost-reused-connections	5.0		amd64	ovn	gcp	ha	427	1m33s	0.00%	1m39.48s	1917.85%
openshift-api-new-connections	5.0		ppc64le	ovn	libvirt	ha	147	4s	0.00%	3m59.2s	3407.33%
ingress-to-console-new-connections	5.0		amd64	ovn	gcp	ha	426	1s	0.00%	2s	70.94%
kube-api-http1-service-network-new-connections	5.0	5.0	amd64	ovn	aws	ha	877	0s	0.00%	17.24s	155.03%
image-registry-new-connections	5.0		amd64	ovn	gcp	ha	426	1s	0.00%	2s	100.00%
pod-to-pod-new-connections	5.0	4.22	amd64	ovn	vsphere	ha	101	0s	0.00%	2m13s	475.76%
kube-api-http1-localhost-new-connections	5.0		amd64	ovn	gcp	ha	111	33s	0.00%	1m12.7s	3189.59%
kube-api-new-connections	5.0	4.22	amd64	ovn	gcp	ha	866	0s	0.00%	2s	100.00%
openshift-api-new-connections	5.0	5.0	amd64	ovn	azure	ha	797	0s	0.00%	4s	100.00%
cache-openshift-api-new-connections	5.0	5.0	amd64	ovn	azure	ha	797	0s	0.00%	2s	100.00%
host-to-pod-new-connections	5.0	4.22	amd64	ovn	vsphere	ha	101	0s	0.00%	2m8s	450.54%
openshift-api-http2-service-network-reused-connections	5.0	4.22	amd64	ovn	vsphere	ha	101	1s	0.00%	2s	73.91%
metrics-api-reused-connections	5.0	4.22	amd64	ovn	vsphere	ha	101	1s	0.00%	2s	73.91%
host-to-host-reused-connections	5.0	4.22	amd64	ovn	vsphere	ha	101	0s	0.00%	2m34s	566.67%
pod-to-service-new-connections	5.0	4.22	amd64	ovn	vsphere	ha	101	0s	0.00%	27s	451.02%
cache-openshift-api-new-connections	5.0		ppc64le	ovn	libvirt	ha	147	4s	0.00%	4m0.2s	2971.61%
ingress-to-oauth-server-new-connections	5.0		ppc64le	ovn	libvirt	ha	146	4s	0.00%	4m5.7s	3589.19%
pod-to-pod-reused-connections	5.0	4.22	amd64	ovn	azure	ha	1094	0s	0.00%	3s	50.00%
pod-to-host-new-connections	5.0	4.22	amd64	ovn	vsphere	ha	101	0s	0.00%	2m34s	566.67%
openshift-api-http2-service-network-new-connections	5.0	4.22	amd64	ovn	vsphere	ha	101	0s	0.00%	2s	1233.33%
host-to-service-new-connections	5.0	4.22	amd64	ovn	vsphere	ha	101	0s	0.00%	25s	380.77%
host-to-host-new-connections	5.0	4.22	amd64	ovn	gcp	ha	866	0s	0.00%	1s	2400.00%
metrics-api-reused-connections	5.0		ppc64le	ovn	libvirt	ha	147	0s	0.00%	2.08s	153.66%
openshift-api-http2-service-network-reused-connections	5.0		multi	ovn	aws	ha	190	0s	0.00%	1s	112.77%
host-to-host-new-connections	5.0	4.22	amd64	ovn	vsphere	ha	101	0s	0.00%	2m34s	566.67%
openshift-api-reused-connections	5.0	5.0	amd64	ovn	azure	ha	797	1s	0.00%	2s	106.19%
ingress-to-oauth-server-new-connections	5.0		multi	ovn	aws	ha	190	0s	0.00%	1.55s	55.00%
ingress-to-console-reused-connections	5.0	4.22	amd64	ovn	vsphere	ha	101	0s	0.00%	1s	566.67%
metrics-api-new-connections	5.0	5.0	amd64	ovn	azure	ha	797	0s	0.00%	3s	512.24%
pod-to-host-new-connections	5.0	5.0	amd64	ovn	azure	ha	797	0s	0.00%	3.08s	208.00%
cache-oauth-api-reused-connections	5.0	5.0	amd64	ovn	aws	ha	877	0s	0.00%	4.92s	70.83%
openshift-api-http2-localhost-reused-connections	5.0	5.0	amd64	ovn	aws	ha	877	1m13s	0.00%	1m58s	97.85%
oauth-api-new-connections	5.0		ppc64le	ovn	libvirt	ha	147	4s	0.00%	3m59.66s	3036.91%
pod-to-host-reused-connections	5.0	4.22	amd64	ovn	vsphere	ha	101	0s	0.00%	2m34s	566.67%
host-to-host-new-connections	5.0	5.0	amd64	ovn	azure	ha	797	0s	0.00%	4s	300.00%
host-to-pod-reused-connections	5.0	5.0	amd64	ovn	aws	ha	877	0s	0.00%	1.48s	48.00%
host-to-pod-reused-connections	5.0	4.22	amd64	ovn	vsphere	ha	101	0s	0.00%	1m3s	172.73%
metrics-api-new-connections	5.0		ppc64le	ovn	libvirt	ha	147	4s	0.00%	4m0.74s	3051.05%
ci-cluster-network-liveness-new-connections	5.0	5.0	amd64	ovn	azure	ha	797	0s	0.00%	6s	308.16%
service-load-balancer-with-pdb-new-connections	5.0		amd64	ovn	gcp	ha	111	0s	0.00%	900ms	164.71%
cache-oauth-api-new-connections	5.0		ppc64le	ovn	libvirt	ha	147	4s	0.00%	4m0.74s	3051.05%

alerts Information

There were (2852) added jobs and (15168) were removed.

Comparisons were above allowed leeway of 30.00%

Note: For P99, alerts had 69 jobs increased and 495 jobs decreased.

Click To Show Table

Name	Release	From	Arch	Network	Platform	Topology	Job Results	P95	P95 % Increase	P99	P99 % Increase
NodeSystemSaturation openshift-monitoring Warning	5.0	5.0	amd64	ovn	azure	ha	245	8m28s	188.64%	25m28.32s	200.85%
HighOverallControlPlaneCPU openshift-kube-apiserver Warning	4.22	4.22	amd64	ovn	gcp	ha	248	3m56s	742.86%	14m29.8s	139.92%
HighOverallControlPlaneCPU openshift-kube-apiserver Warning	4.22	4.21	amd64	ovn	gcp	ha	171	2m56s	188.52%	13m46s	158.67%
ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning	4.22		amd64	ovn	azure	ha	155	2m28s	83.85%	7m9.4s	46.35%
ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning	4.22		arm64	ovn	aws	ha	114	1m28s	152.87%	2m58s	62.41%
TestAlertFeatureE2ETestOTA1813 openshift-cluster-version Critical	5.0		amd64	ovn	azure	ha	155	1m3.2s	81.61%	1m42.6s	43.62%
HighOverallControlPlaneCPU openshift-kube-apiserver Warning	4.22		amd64	ovn	aws	ha	410	28s	233.33%	5m19.72s	90.45%
etcdDatabaseHighFragmentationRatio openshift-etcd Warning	4.22	4.22	amd64	ovn	gcp	ha	248	0s	0.00%	3m55.8s	60.87%
etcdGRPCRequestsSlow openshift-etcd Critical	4.22	4.21	amd64	ovn	azure	ha	241	0s	0.00%	1m46s	82.76%
CannotRetrieveUpdates openshift-cluster-version Warning	4.22		amd64	ovn	gcp	ha	177	2m46s	0.00%	11m48.4s	38.14%
CannotRetrieveUpdates openshift-cluster-version Warning	4.22		amd64	ovn	vsphere	ha	271	1m28s	0.00%	4m46s	60.67%
PodDisruptionBudgetAtLimit openshift-kube-controller-manager Warning	4.22		amd64	ovn	metal	ha	313	0s	0.00%	12m19.04s	73.09%
KubeJobFailed openshift-insights Warning	4.22		arm64	ovn	aws	ha	114	1h56m32.6s	0.00%	4h25m59.04s	122.00%
PodDisruptionBudgetAtLimit openshift-kube-scheduler Warning	4.22		amd64	ovn	metal	ha	313	0s	0.00%	12m19.04s	77.45%
HighOverallControlPlaneCPU openshift-kube-apiserver Warning	4.22		arm64	ovn	aws	ha	114	9.8s	0.00%	56s	100.00%
PodDisruptionBudgetAtLimit openshift-apiserver Warning	4.22		amd64	ovn	metal	ha	313	0s	0.00%	12m15.44s	76.58%
PodDisruptionBudgetAtLimit openshift-oauth-apiserver Warning	4.22		amd64	ovn	metal	ha	313	0s	0.00%	12m19.04s	77.45%
PodDisruptionBudgetAtLimit openshift-kube-apiserver Warning	4.22		amd64	ovn	metal	ha	313	0s	0.00%	12m15.44s	76.58%
PodDisruptionBudgetAtLimit openshift-etcd Warning	4.22		amd64	ovn	metal	ha	313	0s	0.00%	12m19.04s	77.45%
KubeletPlegDurationHigh kube-system Warning	5.0	5.0	amd64	ovn	azure	ha	245	3m28s	0.00%	7m3.2s	42.01%
TestAlertFeatureE2ETestOTA1813 openshift-cluster-version Critical	5.0		amd64	ovn	aws	single	117	1m8s	0.00%	2m3.04s	54.65%
TechPreviewNoUpgrade openshift-kube-apiserver-operator Warning	5.0		amd64	ovn	gcp	ha	181	1h55m0s	0.00%	3h55m3.6s	106.96%
NodeSystemSaturation openshift-monitoring Warning	5.0	5.0	amd64	ovn	aws	ha	276	9m33.5s	0.00%	25m41.5s	72.04%
HighOverallControlPlaneCPU openshift-kube-apiserver Warning	5.0		arm64	ovn	aws	ha	130	0s	0.00%	19.88s	3450.00%
IngressControllerDegraded openshift-ingress-operator Warning	5.0		amd64	ovn	metal	ha	341	0s	0.00%	2m34s	450.00%
MachineWithNoRunningPhase openshift-machine-api Warning	5.0	4.22	amd64	ovn	azure	ha	261	0s	0.00%	32m57.2s	98.72%
HighOverallControlPlaneCPU openshift-kube-apiserver Warning	5.0	5.0	amd64	ovn	aws	ha	276	58s	0.00%	4m19s	54.57%
TestAlertFeatureE2ETestOTA1813 openshift-cluster-version Critical	5.0		amd64	ovn	vsphere	ha	291	1m5s	0.00%	1m54.8s	64.85%
ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning	5.0		amd64	ovn	vsphere	ha	291	0s	0.00%	1m0.8s	54.00%
NodeSystemSaturation openshift-monitoring Warning	5.0		arm64	ovn	aws	ha	130	9m14.5s	0.00%	28m5.38s	66.64%
ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning	5.0	5.0	amd64	ovn	gcp	ha	271	1m28s	0.00%	5m43.4s	48.02%
ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning	5.0		arm64	ovn	aws	ha	130	0s	0.00%	2m1.32s	36.93%

/cc @xueqzhan, @neisw, @smg247

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

[coderabbitai]

Important

Review skipped

Review was skipped as selected files did not have any reviewable changes.

💤 Files selected but had no reviewable changes (3)

• pkg/monitortestlibrary/allowedalerts/query_results.json
• pkg/monitortestlibrary/allowedbackenddisruption/query_results.json
• pkg/test/ginkgo/test_summaries.json

⚙️ Run configuration

Configuration used: Repository YAML (base), Central YAML (inherited)

Review profile: CHILL

Plan: Enterprise

Run ID: 81997c05-88f8-40c3-949d-21d11c39bd1a

📥 Commits

Reviewing files that changed from the base of the PR and between 65f4e3a and adf147f.

📒 Files selected for processing (3)

• pkg/monitortestlibrary/allowedalerts/query_results.json
• pkg/monitortestlibrary/allowedbackenddisruption/query_results.json
• pkg/test/ginkgo/test_summaries.json

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

• 🔍 Trigger review

✨ Finishing Touches

🧪 Generate unit tests (beta)

• Create PR with unit tests

---

_{Comment @coderabbitai help to get the list of available commands and usage tips.}

[openshift-ci]

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: openshift-bot
Once this PR has been reviewed and has the lgtm label, please assign sosiouxme for approval. For more information see the Code Review Process.

The full list of commands accepted by this bot can be found here.

Details

Needs approval from an approver in each of these files:

• OWNERS

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[openshift-ci]

@openshift-bot: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name	Commit	Details	Required	Rerun command
ci/prow/unit	adf147f	link	true	/test unit
ci/prow/images	adf147f	link	true	/test images

Full PR test history. Your PR dashboard.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.