Skip to content
This repository has been archived by the owner on Aug 4, 2023. It is now read-only.

Commit

Permalink
Update Freesound to quarterly, extend timeout (#1068)
Browse files Browse the repository at this point in the history
* Update Freesound to quarterly, extend timeout

* Extend to 50 days

* Update docs
  • Loading branch information
stacimc authored Mar 28, 2023
1 parent 5c2d707 commit 5ad9448
Show file tree
Hide file tree
Showing 2 changed files with 3 additions and 2 deletions.
2 changes: 1 addition & 1 deletion DAGs.md
Original file line number Diff line number Diff line change
Expand Up @@ -71,7 +71,7 @@ The following are DAGs grouped by their primary tag:
| [`europeana_workflow`](#europeana_workflow) | `@daily` | `True` | image |
| [`finnish_museums_workflow`](#finnish_museums_workflow) | `@daily` | `True` | image |
| [`flickr_workflow`](#flickr_workflow) | `@daily` | `True` | image |
| [`freesound_workflow`](#freesound_workflow) | `@monthly` | `False` | audio |
| [`freesound_workflow`](#freesound_workflow) | `@quarterly` | `False` | audio |
| [`inaturalist_workflow`](#inaturalist_workflow) | `@monthly` | `False` | image |
| [`jamendo_workflow`](#jamendo_workflow) | `@monthly` | `False` | audio |
| [`metropolitan_museum_workflow`](#metropolitan_museum_workflow) | `@daily` | `True` | image |
Expand Down
3 changes: 2 additions & 1 deletion openverse_catalog/dags/providers/provider_workflows.py
Original file line number Diff line number Diff line change
Expand Up @@ -220,7 +220,8 @@ def __post_init__(self):
),
ProviderWorkflow(
ingester_class=FreesoundDataIngester,
pull_timeout=timedelta(hours=240), # TODO: Remove after full Freesound run
schedule_string="@quarterly",
pull_timeout=timedelta(days=50),
),
ProviderWorkflow(
ingester_class=INaturalistDataIngester,
Expand Down

0 comments on commit 5ad9448

Please sign in to comment.