-
Notifications
You must be signed in to change notification settings - Fork 48
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
feat(test): Adding betelgeuse docstrings to test_client.py #270
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks good to me. How are you generating the test cases and/or adding them to the junit.xml with betelgeuse? I would like to test this out directly...
Indeed -- this definitely needs to be tested with a github workflow/job, to verify that the format of these various comments, otherwise IMHO it's too easy to screw them up accidentally. |
Other note, don't we need an |
Update from slack convo:
|
6531c62
to
614cfa1
Compare
614cfa1
to
c5a81ab
Compare
fc48d2c
to
1d9779c
Compare
1d9779c
to
8fed77d
Compare
b23ddcf
to
2ec351b
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
There is a bit of inconsistency in the various steps & results that talk about registering with insights-client
:
Steps:
2. Register insights-client 1. Register the insights-client to generate log files 2. Register insights-client and perform pazload operations 1. Register the insights-client
Results:
2. The insights-client registers successfully 1. Insights-client is registered and log files are generated 2. The insights-client registers successfully and logs are populated 1. Insights-client is registrated 1. Insights-client is registered
Ignoring the typos and the numbers, what I personally suggest is:
- keep the step & result to only mention the registration & its successfull result
- move other bits to own steps & results
- use a single wording, for example:
- [step] Register insights-client
- [result] Insights-client is registered successfully
This approach applies also to the testimony docstrings added in other PRs.
I see testimony
validation failures for all the tests like the following:
test_client_files_permission:19
-------------------------------
* Tokens with invalid values:
Tier: Tier 0
type: choice
case sensitive: False
choices: ['tier 1', 'tier 2', 'tier 3']
I'm using the testimony.yml
as currently available in #282, which has:
Tier:
casesensitive: false
required: true
type: choice
choices:
- Tier 1
- Tier 2
- Tier 3
Hm, I wonder whether this seems like a bug in testimony
...
615a450
to
1bce9b5
Compare
I tried to get rid of the inconsistencies in wordings and also correct the typos etc. However I am not sure I understood
However I am not sure I understood this part. If you can explain some more, please. |
1bce9b5
to
9ec8cdd
Compare
Hi @ptoscano, I have corrected the issues with the failing testimony. You can now use the current version of testimony after my last commit on #282. It now should look like this:
|
/packit retest-failed |
9ec8cdd
to
2834144
Compare
I have changed the capitalization to the same format for every test as it was confusing. Hope that's better:) |
Adding betelgeuse docstrings to test_client.py