Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[RAI-15505] Configurable default values #77

Merged
merged 7 commits into from
Aug 28, 2023
Merged

[RAI-15505] Configurable default values #77

merged 7 commits into from
Aug 28, 2023

Conversation

mmcgr
Copy link
Contributor

@mmcgr mmcgr commented Aug 22, 2023

Add a configurable global default for test timeout and allow_unexpected. Update db and engine names to use a similar approach.

Engine naming now has two ways to be configured - changing the default base name (e.g. test_rel-1, test_rel-2, etc) or replacing the generator entirely (e.g. provision engine then generate a different name if there were problems).

@mmcgr mmcgr requested a review from mcmcgrath13 August 22, 2023 01:51
@mmcgr mmcgr changed the title Configurable default values for test timeout and allow_unexpected Configurable default values Aug 22, 2023
@mmcgr mmcgr changed the title Configurable default values [RAI-15505] Configurable default values Aug 22, 2023
src/code-util.jl Outdated
@@ -345,3 +345,8 @@ function get_logging_io()
ctx = IOContext(io, stream)
return io, ctx
end

default_timeout() = parse(Int64, get(ENV, "TEST_REL_TEST_TIMEOUT", "300"))
default_allowed() = Symbol(get(ENV, "TEST_REL_ALLOWED", "warning"))
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

allowed is a little vague here - maybe SEVERITY_ALLOWED ?

Copy link
Contributor

@mcmcgrath13 mcmcgrath13 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

beautiful! one naming thought, but otherwise looks excellent

cc @nystrom this was the PR I was mentioning where you could set the default allow level to :none to get a sense of potential diagnostics changes impact

@mmcgr mmcgr merged commit f3d014b into master Aug 28, 2023
2 checks passed
@mmcgr mmcgr deleted the mm-timeout-reduc branch August 28, 2023 02:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants