Skip to content
This repository has been archived by the owner on Jun 2, 2023. It is now read-only.

Data download checks with log files #105

Open
jds485 opened this issue Apr 28, 2022 · 0 comments
Open

Data download checks with log files #105

jds485 opened this issue Apr 28, 2022 · 0 comments
Labels
enhancement New feature or request

Comments

@jds485
Copy link
Member

jds485 commented Apr 28, 2022

Mentioned in #60,
In the ScienceBase data download target, we can re-download only those items whose date last modified changed in the ScienceBase log file.

Perhaps we should also do something when the NWIS log files change. To have a consistent dataset for modeling, we could set the NWIS downloads to cue = 'never' after the pipeline is built.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant