The Astronomer Blog: Data Orchestration Insights & Guides

January 21, 2021

Near-Real-Time CDC with Airflow and GCP

Learn how to implement near-real-time Change Data Capture (CDC) in Airflow using a scheduled GCP CloudSQL export approach for data pipelines.

January 5, 2021

Deploying Airflow DAGs in Production with dbt (Part 2)

Take your Airflow DAGs live! Learn how to deploy them in production using dbt manifest.json, and integrate dbt into your ETL/ELT workflows.

December 22, 2020

Building a Scalable Analytics Architecture With Airflow and dbt (Part 1)

Kickstart your analytics architecture with Airflow and dbt. Learn DAG authoring, configurations, and code snippets for a seamless setup.

December 17, 2020

The Airflow 2.0 Scheduler

Explore the features of the updated Apache Airflow® 2.0 Scheduler. Learn how the Airflow Scheduler enables quick and seamless initiation of tasks.

November 23, 2020

A Great Expectations Provider for Apache Airflow®

Find out why Great Expectations and Apache Airflow® are a great match. Learn how to leverage native Great Expectations functionality directly from DAGs.

October 29, 2020

Introducing Airflow 2.0

Get to know the highlights of Apache Airflow® 2.0 and see hundreds of new features it includes. Have a look at how Airflow 2.0 compares to Airflow 1.10.

March 17, 2020

Introducing KEDA for Airflow

Explore the possibilities of the Kubernetes Event-Driven Autoscaler. See how KEDA helps users improve the efficiency of their Apache Airflow® deployments.

December 5, 2019

Profiling the Airflow Scheduler With Flame Graphs

Get tips on improving the performance and reliability of the Airflow Scheduler. Find out how to benchmark and profile it using py-spy and Flame Graphs.

December 3, 2019

Why Airflow?

Discover Apache Airflow® and explore its workflow-management capabilities. See which global companies use Airflow to solve data engineering challenges.

Astronomer Blog

Build, run, & observe your data workflows. All in one place.

Build, run, & observe
your data workflows.
All in one place.