Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support partial test case running #105

Open
sj26 opened this issue Jun 28, 2024 · 0 comments
Open

Support partial test case running #105

sj26 opened this issue Jun 28, 2024 · 0 comments

Comments

@sj26
Copy link
Member

sj26 commented Jun 28, 2024

We use rspec tags to run our test suite in pieces. Some of these pieces are based on test type, like system tests which require a heavier setup phase, and can also be distinguishes by file path. But we also have tests throughout out suite which require features only available in local development environments, e.g. a fully functioning privileged docker environment, which are throughout the test suite (not distinguishable by path). We use rspec tags to filter these out (rspec --tag ~docker or SPEC_OPTS="--tag ~docker"). But test splitter doesn't seem to understand these, so splits across files which have no examples, and this can lead to us running jobs that run no tests at all (because they all get filtered out).

e.g.

image

The SplitByExample function looks like it would do what we need, but only operates on slow test files. Is there a way to always split by example, or do smarter discovery of the test suite?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant