Introducing Apache Airflow 2.9
- Kenten Danas Manager, Developer Relations
The Airflow 2.9 release brings significant enhancements to user-favorite features like data-aware scheduling, dynamic task mapping, and object storage.
The Airflow 2.9 release brings significant enhancements to user-favorite features like data-aware scheduling, dynamic task mapping, and object storage.
An introduction to testing strategies, best practices, and implementation techniques.
Our beta cohort of 10 is now joined by 23 hand-selected individuals who, we believe, truly embody what it means to champion the Apache Airflow Project.
Last week, the first-ever in-person Airflow Summit occurred in Toronto, Canada. Over 500 attendees from 20+ countries came together for all things Airflow, orchestration, and open source.
A reference implementation and community dialogue for building production-grade day-2 operations for LLM applications
We discuss the challenges of LLM application development beyond the prototype and why Apache Airflow was highlighted for its ability to enable day-2 operations for LLM applications.
We look at some examples to implement CDC in Airflow using a legacy data pipeline with batch processing, and look at advanced use cases for near-real-time processing.
A detailed guide to building an ETL workflow in Databricks Workflows and Apache Airflow
In this post, we’ll walk through some high level methods for easily debugging your DAGs
In the realm of machine learning, managing workflows efficiently is paramount. One tool that has emerged as a game-changer in this space is Apache Airflow.
A complete guide to handling CDC in Airflow with ease.
The latest minor release includes several new features, such as automatic setup/teardown of tasks, built-in OpenLineage support, cluster activity view, fail-stop functionality, and more.
Try Astro free for 14 days and power your next big data project.