Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
-
Updated
Jan 7, 2025 - Python
Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
🦾 Take control of your AI agents
🎨 UI for the Free Data Engineering Zoomcamp Course provided by DataTalksClub
The Prefect API and backend
A Data Engineering project. Repository for backend infrastructure and Streamlit app files for a Premier League Dashboard.
The home of the Prefect 1 UI
A simple guide to understand Prefect and make it work with your own docker-compose configuration.
Project demonstrating how to automate Prefect 2.0 deployments to AWS ECS Fargate
Code examples showing flow deployment to various types of infrastructure
Tools for using Langchain with Prefect
Example repository showing how to build a data platform with Prefect, dbt and Snowflake
Template to quickly bootstrap a Prefect Collection
Prefect tasks and subflows for interacting with shell commands.
Data Engineering examples for Airflow, Prefect, and Mage.ai; dbt for BigQuery, Redshift, ClickHouse, PostgreSQL; Spark/PySpark for Batch processing; and Kafka for Stream processing
Add a description, image, and links to the prefect topic page so that developers can more easily learn about it.
To associate your repository with the prefect topic, visit your repo's landing page and select "manage topics."