Add a skill for reviewing OpenShift ci results#14572
Open
rhmdnd wants to merge 1 commit intoComplianceAsCode:masterfrom
Open
Add a skill for reviewing OpenShift ci results#14572rhmdnd wants to merge 1 commit intoComplianceAsCode:masterfrom
rhmdnd wants to merge 1 commit intoComplianceAsCode:masterfrom
Conversation
We run periodic CI jobs every week for OpenShift/RHCOS compliance content. This commit adds a skill and script to parse the latest CI results from Prow and builds a compliance report from them. The idea is that we can use this to help keep the assertion files up-to-date in the project by reducing the overall hops required to get to the most recent CI runs and checking the results. The fetch_results.py script can actually be used standalone, which is useful for assessing gaps in testing coverage, or changing rules. But, it can also be fed into the skill so that an agent can help diagnose rules that have been refactored recently, and help update assertion files. Assisted-By: Claude
5e815a5 to
a8ea3c5
Compare
Collaborator
Author
|
@xiaojiey @Anna-Koudelkova @taimurhafeez @Vincent056 @yuumasato feel free to give this a try and see if it helps with managing the overall CI for profiles. You should be able to run the script standalone, which could be put into another directory for reuse (it doesn't need to be packed into the same directory as the skill). |
|
@rhmdnd: The following test failed, say
Full PR test history. Your PR dashboard. DetailsInstructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
We run periodic CI jobs every week for OpenShift/RHCOS compliance
content. This commit adds a skill and script to parse the latest CI
results from Prow and builds a compliance report from them.
The idea is that we can use this to help keep the assertion files
up-to-date in the project by reducing the overall hops required to get
to the most recent CI runs and checking the results.
The fetch_results.py script can actually be used standalone, which is
useful for assessing gaps in testing coverage, or changing rules. But,
it can also be fed into the skill so that an agent can help diagnose
rules that have been refactored recently, and help update assertion
files.
Assisted-By: Claude