Skip to content
This repository has been archived by the owner on Apr 26, 2024. It is now read-only.

Feature Request: Support for AWS Glue Job Execution #307

Closed
1 task done
knakazawa99 opened this issue Sep 4, 2023 · 1 comment · Fixed by #308
Closed
1 task done

Feature Request: Support for AWS Glue Job Execution #307

knakazawa99 opened this issue Sep 4, 2023 · 1 comment · Fixed by #308
Assignees

Comments

@knakazawa99
Copy link
Contributor

Expectation / Proposal

Our team is currently using Prefect for managing our workflows. During the course of our work, we've found a need to execute AWS Glue Jobs as part of our processes.

We've developed an implementation that allows AWS Glue Jobs to be run from Prefect, which is based on the already implemented ECS Task program.

AWS Glue Job is a robust ETL service, and we believe it would be a valuable addition for Prefect users. It can serve as a powerful preprocessor for data used in aggregate processing and machine learning models.

We're confident that this feature would benefit many users, and we're eager to contribute to its development.

Traceback / Example

@knakazawa99
Copy link
Contributor Author

@desertaxle
I created a PR(#308) to add AWS Glue plugin in this issue a few days ago.
It has been 3 weeks since it was assigned to you, but I don't see any progress.
If you have any problems or questions, please let me know.
Thanks

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants