ClimSIPS is a selection protocol designed to select subsets of CMIP5 or CMIP6 models for downstream applications. Results are presented in a ternary contour plot to illustrate how ascribing different levels of priority to performance, independence, and spread affects subset composition.
Metrics are computed from the predictors and formatted for use in the selection step. Metrics are plotted for user edification: - model performance, in order from highest performing (closest to observations) to lowest performing - model independence, displaying the distance of each model to all others in the ensemble - spread, as a scatter of the targeted projection variables (midcentury regional/seasonal average temperature vs. precipitation change)
The selection step computes a cost function for each set of models (m choose n combinations). The cost function is comprised of three terms (performance, independence, and spread) and two parameters (alpha and beta) that set the relative importance of each term. The set of models that minimizes the cost function for each combination of alpha and beta is returned.
The current code allows the user to specify the following:
- selection from 'CMIP5' or 'CMIP6' (models listed in Merrifield et al. 2022)
- flexibility of custom CMIP5 and CMIP6 starting ensembles
- models represented by their ensemble mean (EM) or by an individual member (IM; selected to maximizes overall spread in the ensemble)
- region and season of targeted projection and performance predictors; currently JJA_CEU, DJF_CEU, and DJF_NEU implemented
- size of desired subset (m)
- resolution of the ternary contour plot (alpha and beta)
- a performance threshold to filter out lower performing models prior to the selection step (perf_cutoff)
- an option to run the selection step in parallel on multiple cores (max_workers)
- option to output the minimum or the next to minimum of the cost function (min2)
To run ClimSIPS, you have to create a conda environment that contains the required packages. This can be done by running
conda env create --name ClimSIPS --file ClimSIPS.yml
The package imports performance, independence, and spread predictors. For the European case studies example, predictors are available here: https://www.research-collection.ethz.ch/handle/20.500.11850/599312.
To run the analyis, download the data from the archive above and put it into the folder data in the main project folder.