Apache Airflow
Apache Airflow is a platform to programmatically author, schedule, and monitor workflows, ensuring data engineering efficiency and reliability.
3.3.2 · Stable•Apache-2.0•Since Apr 2015•In-house OSS project
Overall rating
activity, maturity, stars
9.7
/ 10
GitHub stars
47k
Contributors
411
Last commit
1 day ago
Project age
11 years
About
Apache Airflow is a platform designed for orchestrating, monitoring, and scheduling workflows as directed acyclic graphs (DAGs). It enables users to programmatically author workflows and manage their execution. Airflow is built to scale, offering a modular architecture and a user-friendly web interface for tracking task progress, handling retries, and visualizing workflows. It supports integration with various tools and platforms, making it ideal for data pipelines and automation tasks.
Key Features
- DAG-based workflow management.
- Extensive operator and plugin ecosystem.
- Scalability across distributed systems.
- Web-based monitoring and management interface.