Introducing Apache Airflow 2.9
The Airflow 2.9 release brings significant enhancements to user-favorite features like data-aware scheduling, dynamic task mapping, and object storage.
Ensuring Data Pipeline Integrity: A Comprehensive Guide to Testing Airflow DAGs
An introduction to testing strategies, best practices, and implementation techniques.
Introducing Cohort 2 of the Astronomer Champions Program for Apache Airflow!
Our beta cohort of 10 is now joined by 23 hand-selected individuals who, we believe, truly embody what it means to champion the Apache Airflow Project.
3 Key Takeaways from Airflow Summit 2023
Last week, the first-ever in-person Airflow Summit occurred in Toronto, Canada. Over 500 attendees from 20+ countries came together for all things Airflow, orchestration, and open source.
Ask Astro: An open source LLM Application with Apache Airflow, Part 2
A reference implementation and community dialogue for building production-grade day-2 operations for LLM applications
Day 2 Operations for LLMs with Apache Airflow: Going Beyond the Prototype, Part 1
We discuss the challenges of LLM application development beyond the prototype and why Apache Airflow was highlighted for its ability to enable day-2 operations for LLM applications.
Change Data Capture with Airflow - Part 2
We look at some examples to implement CDC in Airflow using a legacy data pipeline with batch processing, and look at advanced use cases for near-real-time processing.
Comparing Data Orchestration: Databricks Workflows vs. Apache Airflow, Part 1
A detailed guide to building an ETL workflow in Databricks Workflows and Apache Airflow
Debugging Airflow Made Easy: 3 Key Steps to Debug your Airflow DAGs
In this post, we’ll walk through some high level methods for easily debugging your DAGs
Orchestrating Machine Learning Pipelines with Airflow
In the realm of machine learning, managing workflows efficiently is paramount. One tool that has emerged as a game-changer in this space is Apache Airflow.
Change Data Capture in Apache Airflow - Part 1
A complete guide to handling CDC in Airflow with ease.
Introducing Airflow 2.7
The latest minor release includes several new features, such as automatic setup/teardown of tasks, built-in OpenLineage support, cluster activity view, fail-stop functionality, and more.
