-
Notifications
You must be signed in to change notification settings - Fork 709
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add Refchecker to Tests #9862
Add Refchecker to Tests #9862
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I have run some of the tests on the RHEL 8 content and when I intentionally removed some CIS references from rules the test started to fail as is expected.
/packit build |
@jan-cerny , I saw you already reviewed this PR once. Are you comfortable to assign it to yourself? |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Sorry for the delay.
The quiet mode isn't good because if the references break and the tests start to fail people can't see which rules fail the test. Don't use the quiet mode or make the errors visible also in quiet mode.
Also please resolve the conflicts.
The script was not using the latest changes in the project and did not run.
Made refchecker use full paths for rule_dir_json, build config, and controls.
Before the first line was being overriden.
Code Climate has analyzed commit 9994c38 and detected 0 issues on this pull request. The test coverage on the diff in this pull request is 100.0% (50% is the threshold). This pull request will bring the total coverage in the repository to 48.8% (0.0% change). View more on Code Climate. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I have run the tests locally and if I break something they start to fail as expected. Also, I have seen that they run in GitHub Actions.
Description:
utils/refchecker.py
utils/refchecker.py
checks for RHEL7 and RHEL8 CIS profilesRationale:
utils/refchecker.py
usefulReview Hints:
linux_os/guide/system/software/integrity/crypto/configure_crypto_policy/rule.yml
, and it should make the tests fail.