Astronomer Webinars

Join us for upcoming online events!

December 5, 2024

How to Orchestrate Databricks Jobs Using Airflow

Hosted By

Kenten Danas Manager, Developer Relations
Tamara Fingerlin Developer Advocate

In this webinar, you’ll learn how to use Airflow to orchestrate your Databricks Jobs by using the Airflow Databricks Provider, Monitor your Databricks Jobs from Airflow, and write tasks that run Databricks Jobs using familiar DAG code

December 11, 2024

Airflow best practices: debugging and testing

In this webinar, you'll learn how to easily and effectively debug your DAGs when an error inevitably occurs, and implement testing so issues don’t make it to production.

February 27, 2025

The State of Airflow 2025

Our panel of experts will discuss the state of Airflow in 2025, including trends and results from the recent annual Airflow survey.

Watch Recorded Webinars On-Demand

April 5, 2022

OpenLineage and Airflow: A Deeper Dive

Data lineage is the complex set of relationships between your jobs and datasets. Using OpenLineage with Apache Airflow®, you can observe and analyze these relationships, allowing you to find and fix issues more quickly. This webinar will provide a deeper dive on OpenLineage, extending beyond the basics into key implementation details and best practices.

March 22, 2022

Improve Your DAGs with Hidden Airflow Features

Apache Airflow® is flexible and powerful. It has a rich ecosystem and an incredibly active community. But are you sure you haven’t missed anything? A new feature or concept that could put your DAGs at another level? It can be challenging to keep up with the latest Airflow features, and sometimes we miss the most useful ones. For this webinar, I'd like to introduce you to a couple of lesser-known features of Apache Airflow® that can dramatically improve your data pipelines.

March 8, 2022

Scaling Out Airflow

Learn about the process of scaling out Airflow with Celery and Kubernetes Executor and the parameters that need to be tuned when adding nodes to Airflow.

February 22, 2022

Data Quality Use Cases with Airflow and Great Expectations

At this webinar, Benji Lampel (Enterprise Platform Architect @ Astronomer) and Tal Gluck (Software Engineer @ Superconductive) will present several Airflow DAGs using Great Expectations that cover more advanced DAG patterns and data quality checking cases.

February 8, 2022

The Airflow API

Learn about Airflow’s fully stable REST API. Find out how to use it and why it’s a great tool for managing and monitoring data pipelines.

January 11, 2022

Introducing Astro: Data Centric DAG Authoring

Learn about Astro, a new DAG writing experience brought by Astronomer. See how we’re taking Airflow 2.0 and the concept of providers to the next level.

December 14, 2021

Data Lineage with OpenLineage and Airflow

If one out of your hundreds of DAGs fails, how do you know which downstream datasets have become out-of-date? The answer is data lineage. Data lineage is the complex set of relationships between your jobs and datasets. In this webinar, you'll learn how to use OpenLineage to collect lineage metadata from Airflow and assemble a lineage graph - a picture of your pipeline worth way more than a thousand words.

November 30, 2021

Best Practices for Writing DAGs in Airflow 2

Because Airflow is 100% code, knowing the basics of Python is all it takes to get started writing DAGs. However, writing DAGs that are efficient, secure, and scalable requires some Airflow-specific finesse. In this webinar, you’ll learn the best practices for writing DAGs that will ensure you get the most out of Airflow. We’ll include a reference repo with DAGs you can run yourself with the Astro CLI.

November 16, 2021

Iterative Data Quality in Airflow DAGs

See why data quality is a valuable part of data systems and how to get started integrating data quality checks into existing pipelines with various tools.

Astronomer Webinars

Watch Recorded Webinars On-Demand

Build, run, & observe your data workflows. All in one place.

Build, run, & observe your data workflows.
All in one place.