You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
This repository has been archived by the owner on Apr 26, 2024. It is now read-only.
Our team is currently using Prefect for managing our workflows. During the course of our work, we've found a need to execute AWS Glue Jobs as part of our processes.
We've developed an implementation that allows AWS Glue Jobs to be run from Prefect, which is based on the already implemented ECS Task program.
AWS Glue Job is a robust ETL service, and we believe it would be a valuable addition for Prefect users. It can serve as a powerful preprocessor for data used in aggregate processing and machine learning models.
We're confident that this feature would benefit many users, and we're eager to contribute to its development.
Traceback / Example
I would like to help contribute a pull request to resolve this!
The text was updated successfully, but these errors were encountered:
@desertaxle
I created a PR(#308) to add AWS Glue plugin in this issue a few days ago.
It has been 3 weeks since it was assigned to you, but I don't see any progress.
If you have any problems or questions, please let me know.
Thanks
Expectation / Proposal
Our team is currently using Prefect for managing our workflows. During the course of our work, we've found a need to execute AWS Glue Jobs as part of our processes.
We've developed an implementation that allows AWS Glue Jobs to be run from Prefect, which is based on the already implemented ECS Task program.
AWS Glue Job is a robust ETL service, and we believe it would be a valuable addition for Prefect users. It can serve as a powerful preprocessor for data used in aggregate processing and machine learning models.
We're confident that this feature would benefit many users, and we're eager to contribute to its development.
Traceback / Example
The text was updated successfully, but these errors were encountered: