-
Notifications
You must be signed in to change notification settings - Fork 4
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
WIP Switch to data time cycling to support multiple models and multiple case studies or trials #765
base: main
Are you sure you want to change the base?
Commits on Sep 16, 2024
-
Add multiple models to rose edit configuration
Also gone through and removed some unneeded things, added titles, etc. Still need to go through the diagnostics. Split diagnostics into sections, add input variable table Also link in more models, so 10 are now supported. Improvements to rose edit metadata Fix a bunch of validation issues
Configuration menu - View commit details
-
Copy full SHA for 35b9dd1 - Browse repository at this point
Copy the full SHA 35b9dd1View commit details -
Configuration menu - View commit details
-
Copy full SHA for c987f80 - Browse repository at this point
Copy the full SHA c987f80View commit details -
Change how data is fetched to work on data time
Also now use subclasses for getting individual files from the various data sources.
Configuration menu - View commit details
-
Copy full SHA for 302b1f8 - Browse repository at this point
Copy the full SHA 302b1f8View commit details -
Modify data fetching in workflow to fetch per model
Grab rose template variables directly, rather than via jinja context Add workflow exported functions to __all__ Add licence header to jinja_utils Require success for processing tasks in workflow Housekeep only on success, but finish workflow regardless
Configuration menu - View commit details
-
Copy full SHA for d8f3042 - Browse repository at this point
Copy the full SHA d8f3042View commit details -
Change recipe format to just use steps, and update infra for running …
…them I've updated one recipe for now, but they will all have to be converted.
Configuration menu - View commit details
-
Copy full SHA for 2816af6 - Browse repository at this point
Copy the full SHA 2816af6View commit details -
The final cycle point task are skipped if doing a continuous trial without a defined end date.
Configuration menu - View commit details
-
Copy full SHA for 7ec7031 - Browse repository at this point
Copy the full SHA 7ec7031View commit details -
Configuration menu - View commit details
-
Copy full SHA for 18f8ae5 - Browse repository at this point
Copy the full SHA 18f8ae5View commit details -
They have all been replaced my the more generic version that work for both the UM and LFRic.
Configuration menu - View commit details
-
Copy full SHA for c0827cf - Browse repository at this point
Copy the full SHA c0827cfView commit details -
Configuration menu - View commit details
-
Copy full SHA for e3ad967 - Browse repository at this point
Copy the full SHA e3ad967View commit details -
Configuration menu - View commit details
-
Copy full SHA for f3f89a4 - Browse repository at this point
Copy the full SHA f3f89a4View commit details -
Configuration menu - View commit details
-
Copy full SHA for 2fe51c8 - Browse repository at this point
Copy the full SHA 2fe51c8View commit details -
Configuration menu - View commit details
-
Copy full SHA for 4ec94c3 - Browse repository at this point
Copy the full SHA 4ec94c3View commit details -
Configuration menu - View commit details
-
Copy full SHA for baa5400 - Browse repository at this point
Copy the full SHA baa5400View commit details -
Differentiate output directories for different case dates
Use cycle point for deterministic resolving.
Configuration menu - View commit details
-
Copy full SHA for c656815 - Browse repository at this point
Copy the full SHA c656815View commit details -
Remove duplicated include file
It was also invalid due to referencing non-existent variables.
Configuration menu - View commit details
-
Copy full SHA for 37e0b35 - Browse repository at this point
Copy the full SHA 37e0b35View commit details -
Configuration menu - View commit details
-
Copy full SHA for 8ae9b99 - Browse repository at this point
Copy the full SHA 8ae9b99View commit details -
Configuration menu - View commit details
-
Copy full SHA for 7b764f9 - Browse repository at this point
Copy the full SHA 7b764f9View commit details -
Configuration menu - View commit details
-
Copy full SHA for a87ed7e - Browse repository at this point
Copy the full SHA a87ed7eView commit details -
Split rose metadata into multiple files
Also rearrange pressure level metadata.
Configuration menu - View commit details
-
Copy full SHA for 39b9816 - Browse repository at this point
Copy the full SHA 39b9816View commit details -
Configuration menu - View commit details
-
Copy full SHA for d216635 - Browse repository at this point
Copy the full SHA d216635View commit details -
Configuration menu - View commit details
-
Copy full SHA for 3855fd7 - Browse repository at this point
Copy the full SHA 3855fd7View commit details -
Configuration menu - View commit details
-
Copy full SHA for 9f7ad76 - Browse repository at this point
Copy the full SHA 9f7ad76View commit details -
Configuration menu - View commit details
-
Copy full SHA for 928390c - Browse repository at this point
Copy the full SHA 928390cView commit details -
Configuration menu - View commit details
-
Copy full SHA for adea843 - Browse repository at this point
Copy the full SHA adea843View commit details -
Configuration menu - View commit details
-
Copy full SHA for 6f440c3 - Browse repository at this point
Copy the full SHA 6f440c3View commit details -
Configuration menu - View commit details
-
Copy full SHA for 1e4c235 - Browse repository at this point
Copy the full SHA 1e4c235View commit details -
Configuration menu - View commit details
-
Copy full SHA for 1cc5866 - Browse repository at this point
Copy the full SHA 1cc5866View commit details -
Configuration menu - View commit details
-
Copy full SHA for cc7d393 - Browse repository at this point
Copy the full SHA cc7d393View commit details -
Q-Q plot recipe is partially converted, pending Issue #808.
Configuration menu - View commit details
-
Copy full SHA for 4d46c7d - Browse repository at this point
Copy the full SHA 4d46c7dView commit details -
Configuration menu - View commit details
-
Copy full SHA for 6e16af2 - Browse repository at this point
Copy the full SHA 6e16af2View commit details -
Configuration menu - View commit details
-
Copy full SHA for 41443f0 - Browse repository at this point
Copy the full SHA 41443f0View commit details -
Configuration menu - View commit details
-
Copy full SHA for 553ab60 - Browse repository at this point
Copy the full SHA 553ab60View commit details -
Configuration menu - View commit details
-
Copy full SHA for 3ec2c85 - Browse repository at this point
Copy the full SHA 3ec2c85View commit details -
Configuration menu - View commit details
-
Copy full SHA for 840ec57 - Browse repository at this point
Copy the full SHA 840ec57View commit details -
Configuration menu - View commit details
-
Copy full SHA for d7c997b - Browse repository at this point
Copy the full SHA d7c997bView commit details -
Configuration menu - View commit details
-
Copy full SHA for 1948f05 - Browse repository at this point
Copy the full SHA 1948f05View commit details -
Configuration menu - View commit details
-
Copy full SHA for 1c2328e - Browse repository at this point
Copy the full SHA 1c2328eView commit details -
Configuration menu - View commit details
-
Copy full SHA for 76ba149 - Browse repository at this point
Copy the full SHA 76ba149View commit details -
Reference UTC timezone as datetime.timezone.utc
The datetime.UTC alias was only added in python 3.11.
Configuration menu - View commit details
-
Copy full SHA for f56e8d5 - Browse repository at this point
Copy the full SHA f56e8d5View commit details -
Add workaround for old python not supporting ISO 8601 datetimes
This should be removed when we drop python 3.10 support.
Configuration menu - View commit details
-
Copy full SHA for e8d8117 - Browse repository at this point
Copy the full SHA e8d8117View commit details -
Configuration menu - View commit details
-
Copy full SHA for 4ed6841 - Browse repository at this point
Copy the full SHA 4ed6841View commit details -
Configuration menu - View commit details
-
Copy full SHA for 9900aa1 - Browse repository at this point
Copy the full SHA 9900aa1View commit details -
Configuration menu - View commit details
-
Copy full SHA for 1915b61 - Browse repository at this point
Copy the full SHA 1915b61View commit details -
Configuration menu - View commit details
-
Copy full SHA for d1f8302 - Browse repository at this point
Copy the full SHA d1f8302View commit details -
Finish website on compute platform
Now it touches the data to generate the index, it probably shouldn't be run on the cylc scheduler.
Configuration menu - View commit details
-
Copy full SHA for 68bdfd9 - Browse repository at this point
Copy the full SHA 68bdfd9View commit details -
Configuration menu - View commit details
-
Copy full SHA for 6790771 - Browse repository at this point
Copy the full SHA 6790771View commit details -
Configuration menu - View commit details
-
Copy full SHA for eb36acc - Browse repository at this point
Copy the full SHA eb36accView commit details -
Remove parallel and collate steps
We've now gone back to just steps.
Configuration menu - View commit details
-
Copy full SHA for 3063f32 - Browse repository at this point
Copy the full SHA 3063f32View commit details -
Configuration menu - View commit details
-
Copy full SHA for 34a1069 - Browse repository at this point
Copy the full SHA 34a1069View commit details -
Configuration menu - View commit details
-
Copy full SHA for 7e75674 - Browse repository at this point
Copy the full SHA 7e75674View commit details -
Configuration menu - View commit details
-
Copy full SHA for 40e54ef - Browse repository at this point
Copy the full SHA 40e54efView commit details -
Configuration menu - View commit details
-
Copy full SHA for 1f3a941 - Browse repository at this point
Copy the full SHA 1f3a941View commit details -
Configuration menu - View commit details
-
Copy full SHA for 322066b - Browse repository at this point
Copy the full SHA 322066bView commit details -
Configuration menu - View commit details
-
Copy full SHA for 2276c9f - Browse repository at this point
Copy the full SHA 2276c9fView commit details -
Change datetime examples to use YYYYMMDDThhmmZ format
It is more familiar to users.
Configuration menu - View commit details
-
Copy full SHA for 018126b - Browse repository at this point
Copy the full SHA 018126bView commit details -
Configuration menu - View commit details
-
Copy full SHA for 0279838 - Browse repository at this point
Copy the full SHA 0279838View commit details -
Clarify that CSET_ANALYSIS_OFFSET
Note that if fixes differences between the initiation time and the first validity time.
Configuration menu - View commit details
-
Copy full SHA for 5442b92 - Browse repository at this point
Copy the full SHA 5442b92View commit details -
Configuration menu - View commit details
-
Copy full SHA for 29d5204 - Browse repository at this point
Copy the full SHA 29d5204View commit details -
Number models from 0 to allow directly using as index
This removes the -1 from all usage in include files.
Configuration menu - View commit details
-
Copy full SHA for 026baa3 - Browse repository at this point
Copy the full SHA 026baa3View commit details -
Configuration menu - View commit details
-
Copy full SHA for 30f83a0 - Browse repository at this point
Copy the full SHA 30f83a0View commit details -
Configuration menu - View commit details
-
Copy full SHA for e72e40f - Browse repository at this point
Copy the full SHA e72e40fView commit details -
Configuration menu - View commit details
-
Copy full SHA for cade4fc - Browse repository at this point
Copy the full SHA cade4fcView commit details -
Configuration menu - View commit details
-
Copy full SHA for c24ecc6 - Browse repository at this point
Copy the full SHA c24ecc6View commit details -
Configuration menu - View commit details
-
Copy full SHA for 330eb59 - Browse repository at this point
Copy the full SHA 330eb59View commit details -
Configuration menu - View commit details
-
Copy full SHA for 5c68f5e - Browse repository at this point
Copy the full SHA 5c68f5eView commit details -
Configuration menu - View commit details
-
Copy full SHA for 7a715d6 - Browse repository at this point
Copy the full SHA 7a715d6View commit details -
Configuration menu - View commit details
-
Copy full SHA for 48ba325 - Browse repository at this point
Copy the full SHA 48ba325View commit details -
Configuration menu - View commit details
-
Copy full SHA for c30c3cc - Browse repository at this point
Copy the full SHA c30c3ccView commit details -
Configuration menu - View commit details
-
Copy full SHA for 39c9650 - Browse repository at this point
Copy the full SHA 39c9650View commit details -
Default to False when setting doesn't exist
This is useful if the setting is not in the rose-suite.conf
Configuration menu - View commit details
-
Copy full SHA for 7669e5e - Browse repository at this point
Copy the full SHA 7669e5eView commit details -
Configuration menu - View commit details
-
Copy full SHA for ab490eb - Browse repository at this point
Copy the full SHA ab490ebView commit details -
Configuration menu - View commit details
-
Copy full SHA for d51a952 - Browse repository at this point
Copy the full SHA d51a952View commit details -
Configuration menu - View commit details
-
Copy full SHA for 8404892 - Browse repository at this point
Copy the full SHA 8404892View commit details -
Configuration menu - View commit details
-
Copy full SHA for c1be5f4 - Browse repository at this point
Copy the full SHA c1be5f4View commit details -
Configuration menu - View commit details
-
Copy full SHA for f101c97 - Browse repository at this point
Copy the full SHA f101c97View commit details -
Configuration menu - View commit details
-
Copy full SHA for 1ce5f15 - Browse repository at this point
Copy the full SHA 1ce5f15View commit details -
The output_dir was in the wrong place, so it was making a POST request.
Configuration menu - View commit details
-
Copy full SHA for acc401c - Browse repository at this point
Copy the full SHA acc401cView commit details -
Configuration menu - View commit details
-
Copy full SHA for a0aff82 - Browse repository at this point
Copy the full SHA a0aff82View commit details -
Configuration menu - View commit details
-
Copy full SHA for e77ab07 - Browse repository at this point
Copy the full SHA e77ab07View commit details
Commits on Sep 17, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 671d58f - Browse repository at this point
Copy the full SHA 671d58fView commit details -
Configuration menu - View commit details
-
Copy full SHA for 725e388 - Browse repository at this point
Copy the full SHA 725e388View commit details -
Configuration menu - View commit details
-
Copy full SHA for 32b0952 - Browse repository at this point
Copy the full SHA 32b0952View commit details -
Configuration menu - View commit details
-
Copy full SHA for 86a7406 - Browse repository at this point
Copy the full SHA 86a7406View commit details -
Configuration menu - View commit details
-
Copy full SHA for b565a04 - Browse repository at this point
Copy the full SHA b565a04View commit details -
Bundle recipes and example data into documentation
This prevents needing to rely on external hosts for these. I did need to drop the example commands to fetch the resources via curl, but they were probably confusing anyway.
Configuration menu - View commit details
-
Copy full SHA for f50ddfe - Browse repository at this point
Copy the full SHA f50ddfeView commit details -
They are not implemented yet, and can be re-added when they are.
Configuration menu - View commit details
-
Copy full SHA for d2d305b - Browse repository at this point
Copy the full SHA d2d305bView commit details -
Configuration menu - View commit details
-
Copy full SHA for 7d94c59 - Browse repository at this point
Copy the full SHA 7d94c59View commit details -
Make area constraint much stricter, and handle date line
The operator now requires all arguments to either be numbers, or all be None if you don't want to constrain the area. The test has been mildly improved, so at least it checks for both of the named functions on the coordinates, though it still doesn't test that they do anything.
Configuration menu - View commit details
-
Copy full SHA for a1bc3ce - Browse repository at this point
Copy the full SHA a1bc3ceView commit details -
Configuration menu - View commit details
-
Copy full SHA for 638f018 - Browse repository at this point
Copy the full SHA 638f018View commit details
Commits on Sep 20, 2024
-
Configuration menu - View commit details
-
Copy full SHA for f18255b - Browse repository at this point
Copy the full SHA f18255bView commit details