Skip to content

Conversation

@stephenfin
Copy link
Member

@stephenfin stephenfin commented Jan 23, 2026

Per $subject.

This also causes us to sync the version of k3s and kubernetes-test used to the latest (v1.35.0)

Release note:

NONE

@k8s-ci-robot k8s-ci-robot added the do-not-merge/release-note-label-needed Indicates that a PR should not merge because it's missing one of the release note labels. label Jan 23, 2026
@k8s-ci-robot k8s-ci-robot requested review from dulek and zetaab January 23, 2026 16:20
@k8s-ci-robot k8s-ci-robot added cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. size/M Denotes a PR that changes 30-99 lines, ignoring generated files. release-note-none Denotes a PR that doesn't merit a release note. and removed do-not-merge/release-note-label-needed Indicates that a PR should not merge because it's missing one of the release note labels. labels Jan 23, 2026
@kayrus
Copy link
Contributor

kayrus commented Jan 23, 2026

/lgtm
/approve

@k8s-ci-robot k8s-ci-robot added the lgtm "Looks good to me", indicates that a PR is ready to be merged. label Jan 23, 2026
@k8s-ci-robot
Copy link
Contributor

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: kayrus

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@k8s-ci-robot k8s-ci-robot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Jan 23, 2026
It's not very stable...

Signed-off-by: Stephen Finucane <stephenfin@redhat.com>
@k8s-ci-robot k8s-ci-robot removed the lgtm "Looks good to me", indicates that a PR is ready to be merged. label Jan 23, 2026
@k8s-ci-robot
Copy link
Contributor

New changes are detected. LGTM label has been removed.

@k8s-ci-robot
Copy link
Contributor

@stephenfin: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
openstack-cloud-csi-manila-e2e-test b627a1e link true /test openstack-cloud-csi-manila-e2e-test
openstack-cloud-csi-cinder-e2e-test b627a1e link true /test openstack-cloud-csi-cinder-e2e-test
openstack-cloud-controller-manager-e2e-test b627a1e link true /test openstack-cloud-controller-manager-e2e-test

Full PR test history. Your PR dashboard. Please help us cut down on flakes by linking to an open issue when you hit one in your PR.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

@kayrus
Copy link
Contributor

kayrus commented Jan 23, 2026

now it fails with

TASK [install-k3s : Wait for ssh ready for k3s VM] *****************************
ok: [136.107.73.144] => {
    "changed": false,
    "elapsed": 16,
    "match_groupdict": {},
    "match_groups": [],
    "path": null,
    "port": 22,
    "search_regex": "OpenSSH",
    "state": "started"
}

TASK [install-k3s : Wait until k3s installation is finished] *******************
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (100 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (99 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (98 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (97 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (96 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (95 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (94 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (93 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (92 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (91 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (90 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (89 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (88 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (87 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (86 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (85 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (84 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (83 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (82 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (81 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (80 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (79 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (78 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (77 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (76 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (75 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (74 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (73 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (72 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (71 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (70 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (69 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (68 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (67 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (66 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (65 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (64 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (63 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (62 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (61 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (60 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (59 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (58 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (57 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (56 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (55 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (54 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (53 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (52 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (51 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (50 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (49 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (48 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (47 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (46 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (45 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (44 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (43 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (42 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (41 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (40 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (39 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (38 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (37 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (36 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (35 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (34 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (33 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (32 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (31 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (30 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (29 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (28 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (27 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (26 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (25 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (24 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (23 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (22 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (21 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (20 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (19 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (18 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (17 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (16 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (15 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (14 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (13 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (12 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (11 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (10 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (9 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (8 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (7 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (6 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (5 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (4 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (3 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (2 retries left).
FAILED - RETRYING: [136.107.73.144]: Wait until k3s installation is finished (1 retries left).
[ERROR]: Task failed: Module failed: non-zero return code
Origin: /home/prow/go/src/k8s.io/cloud-provider-openstack/tests/playbooks/roles/install-k3s/tasks/main.yaml:151:3

149   wait_for: port=22 host={{ k3s_fip }} search_regex=OpenSSH timeout=500 delay=5
150
151 - name: Wait until k3s installation is finished
      ^ column 3

fatal: [136.107.73.144]: FAILED! => {
    "attempts": 100,
    "changed": true,
    "cmd": "ssh -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -i /root/.ssh/id_rsa ubuntu@172.24.5.215 sudo chmod 777 /etc/rancher/k3s/k3s.yaml\n",
    "delta": "0:00:00.690222",
    "end": "2026-01-23 17:20:14.064121",
    "rc": 1,
    "start": "2026-01-23 17:20:13.373899"
}

STDERR:

Warning: Permanently added '172.24.5.215' (ED25519) to the list of known hosts.
chmod: cannot access '/etc/rancher/k3s/k3s.yaml': No such file or directory

@stephenfin
Copy link
Member Author

stephenfin commented Jan 23, 2026

I had a look at this earlier. It looked like it was pulling a non-x86 binary.

k3s.service: Failed to execute /usr/local/bin/k3s: Exec format error

Will investigate next week

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by an approver from all required OWNERS files. cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. release-note-none Denotes a PR that doesn't merit a release note. size/M Denotes a PR that changes 30-99 lines, ignoring generated files.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants