-
Notifications
You must be signed in to change notification settings - Fork 1
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[DATA REQUEST] Add COSIMA experiments #184
Comments
@marc-white, the effort in adding these will be in making sure all the required fields are available and populated in each experiment's Creating/populating the |
@adele-morrison are you the experiment owner for these, or are you able to prod the owner(s) to update/create a |
These docs will be useful for knowing what's needed in the |
Where do I find the |
With new versions of Payu, this will be autogenerated. But for back-filling old experiments you can just generate one for each experiment by running:
|
Ok, this might take a while. As a start, I think the metadata.yaml is ready to go for these experiments: The metadata.yaml looks good for these ones too, but there are permission issues with some of the directories: |
@hrsdawson could you please create metadata.yaml files for these experiments on cj50: Is there supposed to be the 01deg_jra55v13_ryf9091_ssp585_mw experiment on cj50 also? I can't see it. |
@kialstewart, currently the metadata.yaml for these experiments are all identical: Can you please fix? |
@mauricehuguenin I'm still having permission issues accessing the data in these directories on /g/data/cj50/access-om2/raw-output/access-om2-01/: 01deg_jra55_ryf_Control/output984/ - output989 I think we'll need to sort this before we can add to the Intake Catalog. |
Thanks Adele, I sent [email protected] a new mail again if they could make the folder group-readable. When I tried using |
Hi @mauricehuguenin @hrsdawson @kialstewart how are you going with metadata generation? Do you need any assistance? |
Hi Marc, I made metadata.yaml files for each of my three output folders in |
Hi Marc,
I believe I've sufficiently edited the metadata.yaml for the 4 SAMx
perturbation experiments in the access-om2-01 raw_output directory on cj50.
These runs predate several of the suggested metadata fields; for these I've
listed them as "unknown".
Thanks!!
Kial
…On Mon, 30 Sept 2024 at 22:47, Maurice F. Huguenin ***@***.***> wrote:
Hi Marc,
the issue from above, #184 (comment)
<#184 (comment)>,
has now been fixed.
I made metadata.yaml files for each of my three output folders in
/g/data/cj50/access-om2/raw-output/access-om2-01/, those being
01deg_jra55_ryf_Control, 01deg_jra55_ryf_ENFull & 01deg_jra55_ryf_LNFull.
Let me know if more info is required for my metadata files. It has been a
few months since I created them and maybe guidelines have changed since
then.
—
Reply to this email directly, view it on GitHub
<#184 (comment)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/ABSWJ3UODLGGO7T3JZBTDJLZZFB4JAVCNFSM6AAAAABMXBXEZOVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDGOBTGA4TEMJZHE>
.
You are receiving this because you were mentioned.Message ID:
***@***.***>
|
Hi @kialstewart , instead of unknown, could you please just leave them blank, e.g.: realm: This will cause @mauricehuguenin could you please update yours similarly as well? |
Done. Thanks!!
Kial
…On Tue, 1 Oct 2024 at 10:19, Marc White ***@***.***> wrote:
Hi Marc, I believe I've sufficiently edited the metadata.yaml for the 4
SAMx perturbation experiments in the access-om2-01 raw_output directory on
cj50. These runs predate several of the suggested metadata fields; for
these I've listed them as "unknown". Thanks!! Kial
Hi @kialstewart <https://github.com/kialstewart> , instead of unknown,
could you please just leave them blank, e.g.:
realm:
This will cause intake to correctly ingest them as being empty;
otherwise, it will think, e.g., there's a new realm called 'unknown'.
—
Reply to this email directly, view it on GitHub
<#184 (comment)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/ABSWJ3UDPHG6NITPDY5Q6RTZZHMAJAVCNFSM6AAAAABMXBXEZOVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDGOBUGUZTSMRRGI>
.
You are receiving this because you were mentioned.Message ID:
***@***.***>
|
@marc-white Done so as well now. Thanks for the update. |
Description of the data product
There are a bunch of COSIMA experiments that are missing in the Intake Catalog. As a start, it would be great to have everything here:
/g/data/cj50/access-om2/raw-output/access-om2-01/
in the Catalog, with the exception of
01deg_jra55v13_ryf9091
, which we already have fromik11
.That means, adding these experiments:
01deg_jra55_ryf_Control
01deg_jra55v13_ryf9091_qian_wthmp
01deg_jra55_ryf_ENFull
01deg_jra55v13_ryf9091_qian_wthp
01deg_jra55_ryf_LNFull
01deg_jra55v13_ryf9091_ssp245
01deg_jra55_SAMextr_0203_from9091
01deg_jra55v13_ryf9091_ssp245_mw
01deg_jra55_SAMextr_1011_from9091
01deg_jra55v13_ryf9091_ssp585
01deg_jra55_SAMextr_9192_from9091
01deg_jra55v13_ryf9091_weddell_down2
01deg_jra55_SAMextr_9899_from9091
01deg_jra55v13_ryf9091_weddell_up1
01deg_jra55v13_ryf9091_easterlies_down10
01deg_jra55v13_ryf9091_easterlies_up10
01deg_jra55v13_ryf9091_easterlies_up10_meridional
01deg_jra55v13_ryf9091_easterlies_up10_zonal
Location of the data product on Gadi
/g/data/cj50/access-om2/raw-output/access-om2-01/
Checklist
Add a "x" between the brackets to all that apply
The text was updated successfully, but these errors were encountered: