Prefect (vs airflow)

BigData

Prefect (vs airflow)

Kyle79 2021. 10. 29. 16:02

https://www.prefect.io/

Prefect - The New Standard in Dataflow Automation

Prefect is a new data workflow management system, designed for modern infrastructure. Prefect provides a flexible open-source Python framework to easily combine tasks into workflows, then deploy, schedule, and monitor their execution through the Prefect UI

www.prefect.io

https://dailyheumsi.tistory.com/264

Prefect - Quick Review

Workflow 툴인 Prefect에 대해서 Quick하게 리뷰해보려고 한다. 이게 대체 뭔가 함은... 일단은 Apache Airflow 같이 워크 플로우를 정의하고 스케쥴링 돌리며, 이 모든 것을 체계적으로 매니징하는 오케스

dailyheumsi.tistory.com

https://hub.docker.com/r/prefecthq/prefect

Docker Hub

hub.docker.com

https://github.com/dojeda/prefect-helm

GitHub - dojeda/prefect-helm: A helm chart for Prefect

A helm chart for Prefect. Contribute to dojeda/prefect-helm development by creating an account on GitHub.

github.com