From 61b3f912f2a0b0384845939421c36a36effc7ec3 Mon Sep 17 00:00:00 2001 From: Zach Burnett Date: Fri, 15 Nov 2024 15:20:09 -0500 Subject: [PATCH] metadata for release 0.17.0 (#1521) --- CHANGES.rst | 138 +++++++++++++++++++++++++++ README.md | 1 + changes/1357.outlier_detection.0.rst | 1 - changes/1357.outlier_detection.1.rst | 1 - changes/1357.outlier_detection.2.rst | 1 - changes/1373.general.rst | 1 - changes/1375.docs.rst | 1 - changes/1383.resample.rst | 1 - changes/1394.mosaic_pipeline.rst | 1 - changes/1398.ramp_fitting.rst | 1 - changes/1399.general.rst | 1 - changes/1411.associations.rst | 1 - changes/1419.docs.rst | 1 - changes/1426.general.rst | 1 - changes/1433.general.rst | 1 - changes/1436.outlier_detection.rst | 1 - changes/1437.associations.rst | 2 - changes/1445.general.rst | 1 - changes/1446.general.rst | 1 - changes/1447.general.rst | 1 - changes/1448.outlier_detection.1.rst | 1 - changes/1448.resample.2.rst | 1 - changes/1448.tweakreg.0.rst | 1 - changes/1456.general.rst | 1 - changes/1457.source_catalog.rst | 2 - changes/1471.associations.rst | 1 - changes/1473.general.rst | 1 - changes/1484.tweakreg.rst | 1 - changes/1485.multiband_catalog.rst | 1 - changes/1493.general.rst | 1 - changes/1498.resample.rst | 1 - changes/1503.source_detection.rst | 1 - changes/1505.associations.rst | 1 - changes/1509.stpipe.rst | 1 - changes/1512.source_catalog.rst | 1 - requirements-sdp.txt | 110 ++++++++++++++++++++- 36 files changed, 248 insertions(+), 36 deletions(-) delete mode 100644 changes/1357.outlier_detection.0.rst delete mode 100644 changes/1357.outlier_detection.1.rst delete mode 100644 changes/1357.outlier_detection.2.rst delete mode 100644 changes/1373.general.rst delete mode 100644 changes/1375.docs.rst delete mode 100644 changes/1383.resample.rst delete mode 100644 changes/1394.mosaic_pipeline.rst delete mode 100644 changes/1398.ramp_fitting.rst delete mode 100644 changes/1399.general.rst delete mode 100644 changes/1411.associations.rst delete mode 100644 changes/1419.docs.rst delete mode 100644 changes/1426.general.rst delete mode 100644 changes/1433.general.rst delete mode 100644 changes/1436.outlier_detection.rst delete mode 100644 changes/1437.associations.rst delete mode 100644 changes/1445.general.rst delete mode 100644 changes/1446.general.rst delete mode 100644 changes/1447.general.rst delete mode 100644 changes/1448.outlier_detection.1.rst delete mode 100644 changes/1448.resample.2.rst delete mode 100644 changes/1448.tweakreg.0.rst delete mode 100644 changes/1456.general.rst delete mode 100644 changes/1457.source_catalog.rst delete mode 100644 changes/1471.associations.rst delete mode 100644 changes/1473.general.rst delete mode 100644 changes/1484.tweakreg.rst delete mode 100644 changes/1485.multiband_catalog.rst delete mode 100644 changes/1493.general.rst delete mode 100644 changes/1498.resample.rst delete mode 100644 changes/1503.source_detection.rst delete mode 100644 changes/1505.associations.rst delete mode 100644 changes/1509.stpipe.rst delete mode 100644 changes/1512.source_catalog.rst diff --git a/CHANGES.rst b/CHANGES.rst index e73e53971..6f7d53dd0 100644 --- a/CHANGES.rst +++ b/CHANGES.rst @@ -1,3 +1,141 @@ +0.17.0 (2024-11-15) +=================== + +General +------- + +- Update source catalog file with the tweaked coordinates. (`#1373 + `_) +- move DMS requirement <-> test correlations from ``@metrics_logger()`` + decorators to ``romancal/tests/dms_requirement_tests.json`` (`#1399 + `_) +- Break up long regression tests to avoid needing to okify results twice. + (`#1426 `_) +- Removed now unused lib.dms. (`#1433 + `_) +- Remove units from romancal. (`#1445 + `_) +- Have pytest clean up some files when it finishes running tests. (`#1446 + `_) +- Fix remaining numpy 2 issues and unpin numpy to allow numpy 2 usage. (`#1447 + `_) +- Give regtest okify results unique subdirectories. (`#1456 + `_) +- Updates to support L1/L2 schema changes. (`#1473 + `_) +- Use stcal to compute s_region keyword. (`#1493 + `_) + + +Documentation +------------- + +- handle changelog entries with ``towncrier`` (`#1375 + `_) +- Update docs to not include default fake values. (`#1419 + `_) + + +``stpipe`` +---------- + +- Add class_alias for all steps. (`#1509 + `_) + + +Associations +------------ + +- add target to asn_from_list command (`#1411 + `_) +- Added code to take an input list of calibrated WFI exposures and creates + associations based on the + skycells that they overlap (`#1437 + `_) +- Update skycell_asn docs and add skycell_asn as a script at install time + (`#1471 `_) +- Updates to the file naming for the products and inputs and adds the + orientation to the wcs keywords in the asn header (`#1505 + `_) + + +``mosaic_pipeline`` +------------------- + +- Allow asn product name to be the output product (`#1394 + `_) + + +``ramp_fitting`` (WFI-Image, WFI-Prism, WFI-Grism) +-------------------------------------------------- + +- Drop support for ``ols`` ramp fitting. (`#1398 + `_) + + +``source_detection`` (WFI-Image) +-------------------------------- + +- Don't restart loggers during create_gridded_psf_model. (`#1503 + `_) + + +``tweakreg`` (WFI-Image) +------------------------ + +- Group by obs_id (`#1448 + `_) +- Updates s_region after running TweakRegStep successfully. (`#1484 + `_) + + +``outlier_detection`` +--------------------- + +- Update input handling to raise an exception on an invalid input instead of + issuing a warning and skipping the step. (`#1357 + `_) +- Remove unused arguments to outlier detection. (`#1357 + `_) +- Use stcal common code in outlier detection. (`#1357 + `_) +- Fix bug where on_disk=True could fail due to Quantities not implementing + tofile. (`#1436 `_) +- Group by obs_id (`#1448 + `_) + + +``resample`` +------------ + +- Fixed an incompatibility with ``numpy 2.0`` in + ``resample.resample_utils.build_mask()``. Switched code in + ``build_driz_weight()`` to use ``astropy`` equivalent of ``build_mask()``. + Deprecated ``resample.resample_utils.build_mask()``. (`#1383 + `_) +- Group by obs_id (`#1448 + `_) +- Update resample to populate location_name attribute and tests to check for it + (`#1498 `_) + + +``source_catalog`` +------------------ + +- The data and err array of the input datamodel to the source_catalog step + are now copied so that they are left completely unchanged by the step. + (`#1457 `_) +- Restored flux units in source catalog table. (`#1512 + `_) + + +``multiband_catalog`` +--------------------- + +- Added a pipeline step to create a multiband catalog from L3 images. (`#1485 + `_) + + 0.16.3 (2024-08-29) =================== diff --git a/README.md b/README.md index 1ecbb1740..dfad62997 100644 --- a/README.md +++ b/README.md @@ -171,6 +171,7 @@ an [issue](https://github.com/spacetelescope/romancal/issues). | 0.16.1 | 24Q4_B15 | 063 | Aug 2024 | Release for Build 24Q3_B15 (Build 15) | | 0.16.2 | 24Q4_B15 | 063 | Aug 2024 | Release for Build 24Q3_B15 (Build 15) | | 0.16.3 | 24Q4_B15 | 063 | Aug 2024 | Release for Build 24Q3_B15 (Build 15) | +| 0.17.0 | 25Q1_B16 | 065 | Nov 2024 | Release for Build 25Q1_B16 (Build 16) | Note: CRDS_CONTEXT values flagged with an asterisk in the above table are estimates diff --git a/changes/1357.outlier_detection.0.rst b/changes/1357.outlier_detection.0.rst deleted file mode 100644 index 3c3667401..000000000 --- a/changes/1357.outlier_detection.0.rst +++ /dev/null @@ -1 +0,0 @@ -Remove unused arguments to outlier detection. diff --git a/changes/1357.outlier_detection.1.rst b/changes/1357.outlier_detection.1.rst deleted file mode 100644 index 798d48c35..000000000 --- a/changes/1357.outlier_detection.1.rst +++ /dev/null @@ -1 +0,0 @@ -Update input handling to raise an exception on an invalid input instead of issuing a warning and skipping the step. diff --git a/changes/1357.outlier_detection.2.rst b/changes/1357.outlier_detection.2.rst deleted file mode 100644 index dc0be573d..000000000 --- a/changes/1357.outlier_detection.2.rst +++ /dev/null @@ -1 +0,0 @@ -Use stcal common code in outlier detection. diff --git a/changes/1373.general.rst b/changes/1373.general.rst deleted file mode 100644 index 359959479..000000000 --- a/changes/1373.general.rst +++ /dev/null @@ -1 +0,0 @@ -Update source catalog file with the tweaked coordinates. diff --git a/changes/1375.docs.rst b/changes/1375.docs.rst deleted file mode 100644 index 77509605d..000000000 --- a/changes/1375.docs.rst +++ /dev/null @@ -1 +0,0 @@ -handle changelog entries with ``towncrier`` diff --git a/changes/1383.resample.rst b/changes/1383.resample.rst deleted file mode 100644 index 53ad0fd4f..000000000 --- a/changes/1383.resample.rst +++ /dev/null @@ -1 +0,0 @@ -Fixed an incompatibility with ``numpy 2.0`` in ``resample.resample_utils.build_mask()``. Switched code in ``build_driz_weight()`` to use ``astropy`` equivalent of ``build_mask()``. Deprecated ``resample.resample_utils.build_mask()``. diff --git a/changes/1394.mosaic_pipeline.rst b/changes/1394.mosaic_pipeline.rst deleted file mode 100644 index 08cebb565..000000000 --- a/changes/1394.mosaic_pipeline.rst +++ /dev/null @@ -1 +0,0 @@ -Allow asn product name to be the output product diff --git a/changes/1398.ramp_fitting.rst b/changes/1398.ramp_fitting.rst deleted file mode 100644 index c2d1b691d..000000000 --- a/changes/1398.ramp_fitting.rst +++ /dev/null @@ -1 +0,0 @@ -Drop support for ``ols`` ramp fitting. diff --git a/changes/1399.general.rst b/changes/1399.general.rst deleted file mode 100644 index 461155ef1..000000000 --- a/changes/1399.general.rst +++ /dev/null @@ -1 +0,0 @@ -move DMS requirement <-> test correlations from ``@metrics_logger()`` decorators to ``romancal/tests/dms_requirement_tests.json`` diff --git a/changes/1411.associations.rst b/changes/1411.associations.rst deleted file mode 100644 index 4215481a9..000000000 --- a/changes/1411.associations.rst +++ /dev/null @@ -1 +0,0 @@ -add target to asn_from_list command diff --git a/changes/1419.docs.rst b/changes/1419.docs.rst deleted file mode 100644 index 7e7a16cf6..000000000 --- a/changes/1419.docs.rst +++ /dev/null @@ -1 +0,0 @@ -Update docs to not include default fake values. diff --git a/changes/1426.general.rst b/changes/1426.general.rst deleted file mode 100644 index d0f047e34..000000000 --- a/changes/1426.general.rst +++ /dev/null @@ -1 +0,0 @@ -Break up long regression tests to avoid needing to okify results twice. diff --git a/changes/1433.general.rst b/changes/1433.general.rst deleted file mode 100644 index 153d72ca5..000000000 --- a/changes/1433.general.rst +++ /dev/null @@ -1 +0,0 @@ -Removed now unused lib.dms. diff --git a/changes/1436.outlier_detection.rst b/changes/1436.outlier_detection.rst deleted file mode 100644 index 045081ea0..000000000 --- a/changes/1436.outlier_detection.rst +++ /dev/null @@ -1 +0,0 @@ -Fix bug where on_disk=True could fail due to Quantities not implementing tofile. diff --git a/changes/1437.associations.rst b/changes/1437.associations.rst deleted file mode 100644 index e11f18567..000000000 --- a/changes/1437.associations.rst +++ /dev/null @@ -1,2 +0,0 @@ -Added code to take an input list of calibrated WFI exposures and creates associations based on the -skycells that they overlap diff --git a/changes/1445.general.rst b/changes/1445.general.rst deleted file mode 100644 index 4471074d0..000000000 --- a/changes/1445.general.rst +++ /dev/null @@ -1 +0,0 @@ -Remove units from romancal. diff --git a/changes/1446.general.rst b/changes/1446.general.rst deleted file mode 100644 index 4fe43376b..000000000 --- a/changes/1446.general.rst +++ /dev/null @@ -1 +0,0 @@ -Have pytest clean up some files when it finishes running tests. diff --git a/changes/1447.general.rst b/changes/1447.general.rst deleted file mode 100644 index 76aab5a00..000000000 --- a/changes/1447.general.rst +++ /dev/null @@ -1 +0,0 @@ -Fix remaining numpy 2 issues and unpin numpy to allow numpy 2 usage. diff --git a/changes/1448.outlier_detection.1.rst b/changes/1448.outlier_detection.1.rst deleted file mode 100644 index 2080601d1..000000000 --- a/changes/1448.outlier_detection.1.rst +++ /dev/null @@ -1 +0,0 @@ -Group by obs_id diff --git a/changes/1448.resample.2.rst b/changes/1448.resample.2.rst deleted file mode 100644 index 2080601d1..000000000 --- a/changes/1448.resample.2.rst +++ /dev/null @@ -1 +0,0 @@ -Group by obs_id diff --git a/changes/1448.tweakreg.0.rst b/changes/1448.tweakreg.0.rst deleted file mode 100644 index 2080601d1..000000000 --- a/changes/1448.tweakreg.0.rst +++ /dev/null @@ -1 +0,0 @@ -Group by obs_id diff --git a/changes/1456.general.rst b/changes/1456.general.rst deleted file mode 100644 index 435de0242..000000000 --- a/changes/1456.general.rst +++ /dev/null @@ -1 +0,0 @@ -Give regtest okify results unique subdirectories. diff --git a/changes/1457.source_catalog.rst b/changes/1457.source_catalog.rst deleted file mode 100644 index 16581605f..000000000 --- a/changes/1457.source_catalog.rst +++ /dev/null @@ -1,2 +0,0 @@ -The data and err array of the input datamodel to the source_catalog step -are now copied so that they are left completely unchanged by the step. diff --git a/changes/1471.associations.rst b/changes/1471.associations.rst deleted file mode 100644 index 4caeda3a6..000000000 --- a/changes/1471.associations.rst +++ /dev/null @@ -1 +0,0 @@ -Update skycell_asn docs and add skycell_asn as a script at install time diff --git a/changes/1473.general.rst b/changes/1473.general.rst deleted file mode 100644 index ec71d6c36..000000000 --- a/changes/1473.general.rst +++ /dev/null @@ -1 +0,0 @@ -Updates to support L1/L2 schema changes. diff --git a/changes/1484.tweakreg.rst b/changes/1484.tweakreg.rst deleted file mode 100644 index c5b43718c..000000000 --- a/changes/1484.tweakreg.rst +++ /dev/null @@ -1 +0,0 @@ -Updates s_region after running TweakRegStep successfully. diff --git a/changes/1485.multiband_catalog.rst b/changes/1485.multiband_catalog.rst deleted file mode 100644 index 828e990b7..000000000 --- a/changes/1485.multiband_catalog.rst +++ /dev/null @@ -1 +0,0 @@ -Added a pipeline step to create a multiband catalog from L3 images. diff --git a/changes/1493.general.rst b/changes/1493.general.rst deleted file mode 100644 index a86406e5e..000000000 --- a/changes/1493.general.rst +++ /dev/null @@ -1 +0,0 @@ -Use stcal to compute s_region keyword. diff --git a/changes/1498.resample.rst b/changes/1498.resample.rst deleted file mode 100644 index 3fa5f85db..000000000 --- a/changes/1498.resample.rst +++ /dev/null @@ -1 +0,0 @@ -Update resample to populate location_name attribute and tests to check for it diff --git a/changes/1503.source_detection.rst b/changes/1503.source_detection.rst deleted file mode 100644 index c566dc084..000000000 --- a/changes/1503.source_detection.rst +++ /dev/null @@ -1 +0,0 @@ -Don't restart loggers during create_gridded_psf_model. diff --git a/changes/1505.associations.rst b/changes/1505.associations.rst deleted file mode 100644 index a6987fbe2..000000000 --- a/changes/1505.associations.rst +++ /dev/null @@ -1 +0,0 @@ - Updates to the file naming for the products and inputs and adds the orientation to the wcs keywords in the asn header diff --git a/changes/1509.stpipe.rst b/changes/1509.stpipe.rst deleted file mode 100644 index 0dd6b50b9..000000000 --- a/changes/1509.stpipe.rst +++ /dev/null @@ -1 +0,0 @@ -Add class_alias for all steps. diff --git a/changes/1512.source_catalog.rst b/changes/1512.source_catalog.rst deleted file mode 100644 index 98e9ceaf8..000000000 --- a/changes/1512.source_catalog.rst +++ /dev/null @@ -1 +0,0 @@ -Restored flux units in source catalog table. diff --git a/requirements-sdp.txt b/requirements-sdp.txt index b1ee1b615..9b39a5da7 100644 --- a/requirements-sdp.txt +++ b/requirements-sdp.txt @@ -5,5 +5,113 @@ # # Add a CRDS context number for the delivery as a record here # -# CRDS_CONTEXT = roman_0063.pmap +# CRDS_CONTEXT = roman_0065.pmap # +asdf==3.5.0 +asdf-astropy==0.7.0 +asdf-coordinates-schemas==0.3.0 +asdf-standard==1.1.1 +asdf-transform-schemas==0.5.0 +asdf-wcs-schemas==0.4.0 +astropy==6.1.6 +astropy-iers-data==0.2024.11.11.0.32.38 +astroquery==0.4.7 +attrs==24.2.0 +backports-tarfile==1.2.0 +beautifulsoup4==4.12.3 +certifi==2024.8.30 +charset-normalizer==3.4.0 +ci-watson==0.7.0 +click==8.1.7 +contourpy==1.3.1 +coverage==7.6.7 +crds==12.0.5 +cycler==0.12.1 +deepdiff==8.0.1 +drizzle==2.0.0 +et-xmlfile==2.0.0 +exceptiongroup==1.2.2 +filelock==3.16.1 +fonttools==4.55.0 +gwcs==0.21.0 +html5lib==1.1 +hypothesis==6.119.1 +idna==3.10 +imageio==2.36.0 +importlib-metadata==8.5.0 +iniconfig==2.0.0 +jaraco-classes==3.4.0 +jaraco-context==6.0.1 +jaraco-functools==4.1.0 +jinja2==3.1.4 +jmespath==1.0.1 +jsonschema==4.23.0 +jsonschema-specifications==2024.10.1 +keyring==25.5.0 +kiwisolver==1.4.7 +lazy-loader==0.4 +lxml==5.3.0 +markdown-it-py==3.0.0 +markupsafe==3.0.2 +matplotlib==3.9.2 +mdurl==0.1.2 +more-itertools==10.5.0 +networkx==3.4.2 +numpy==2.1.3 +opencv-python-headless==4.10.0.84 +openpyxl==3.1.5 +orderly-set==5.2.2 +packaging==24.2 +parsley==1.3 +photutils==2.0.2 +pillow==11.0.0 +pluggy==1.5.0 +poppy==1.1.1 +pyerfa==2.0.1.5 +pygments==2.18.0 +pyparsing==3.2.0 +pysiaf==0.23.3 +pytest==8.3.3 +pytest-arraydiff==0.6.1 +pytest-astropy==0.11.0 +pytest-astropy-header==0.2.2 +pytest-cov==6.0.0 +pytest-doctestplus==1.2.1 +pytest-filter-subpackage==0.2.0 +pytest-mock==3.14.0 +pytest-remotedata==0.4.1 +python-dateutil==2.9.0.post0 +pyvo==1.6 +pyyaml==6.0.2 +rad==0.22.0 +referencing==0.35.1 +requests==2.32.3 +rich==13.9.4 +roman-datamodels==0.22.0 +-e file:///Users/zburnett/projects/romancal +rpds-py==0.21.0 +scikit-image==0.24.0 +scipy==1.14.1 +semantic-version==2.10.0 +setuptools==75.5.0 +shellingham==1.5.4 +six==1.16.0 +sortedcontainers==2.4.0 +soupsieve==2.6 +spherical-geometry==1.3.2 +stcal==1.10.0 +stpipe==0.7.0 +stpreview==0.5.1 +stsci-imagestats==1.8.3 +stsci-stimage==0.2.9 +synphot==1.4.0 +tifffile==2024.9.20 +tomli==2.1.0 +towncrier==24.8.0 +tweakwcs==0.8.9 +typer==0.13.0 +typing-extensions==4.12.2 +urllib3==2.2.3 +webbpsf==1.4.0 +webencodings==0.5.1 +zipp==3.21.0