Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
Workflow Engine for Kubernetes
Apache DolphinScheduler is the modern data orchestration platform. Agile to create high performance workflow with low-code
PipelineAI
Build data pipelines, the easy way π οΈ
Curated list of resources about Apache Airflow
Docker Apache Airflow
DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.
Elyra extends JupyterLab with an AI centric approach.
A series of DAGs/Workflows to help maintain the operation of Airflow
Few projects related to Data Engineering including Data Modeling, Infrastructure setup on cloud, Data Warehousing and Data Lake development.
An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.
More than 2000+ Data engineer interview questions.
Construct Apache Airflow DAGs Declaratively via YAML configuration files
Example end to end data engineering project.
A Data Engineering & Machine Learning Knowledge Hub
Run your dbt Core or dbt Fusion projects as Apache Airflow DAGs and Task Groups with a few lines of code
Personal Data Engineering Projects
π The Full Stack 7-Steps MLOps Framework | Learn MLE & MLOps for free by designing, building and deploying an end-to-end ML batch system ~ source code + 2.5 hours of reading & video materials
Optimus is an easy-to-use, reliable, and performant workflow orchestrator for data transformation, data modeling, pipelines, and data quality management.
Add a description, image, and links to the airflow topic page so that developers can more easily learn about it.
To associate your repository with the airflow topic, visit your repo's landing page and select "manage topics."