Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow arbitrarily many models in a single CSET run #817

Open
jfrost-mo opened this issue Aug 30, 2024 · 1 comment
Open

Allow arbitrarily many models in a single CSET run #817

jfrost-mo opened this issue Aug 30, 2024 · 1 comment
Labels
enhancement New feature or request

Comments

@jfrost-mo
Copy link
Member

What problem does your feature request solve?

Currently we are limited to 10 models, due to hard coding the rose-meta.conf file with this many sections. If you want to run more than that you are required to first modify the rose-meta.conf (and a single line in jinja_utils.py).

Describe the solution you'd like

Ideally we'd dynamically allow this at runtime, however rose config-edit doesn't support this. Instead we could follow the example of the RES, and have a script to generate the rose-meta.conf with the required number of models. With this it would be easier for people to add their own limit, or even for us to ship a much higher default limit (e.g. hundreds).

Describe alternatives you've considered

This might not actually be needed, as no one I've talked to can think of a case where you would be comparing more than 10 different models.

@SGallagherMet
Copy link

Just for the record, I have been contacted by people asking if the Regional Evaluation Suite could be made to do more than 10 models. It's very infrequent but it has happened in the past.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants