New in Airflow 3.0: Data Assets and Event-Driven Scheduling Deep Dive

Airflow 3.0 brings the next evolution in data awareness with assets, an expansion of the foundational datasets feature that lets you create DAGs around the movement of your data. This release also rolled out asset watchers, the most powerful option for event-driven scheduling in Airflow to date, that continuously monitors message queues and triggers pipelines the moment new data arrives.

Together, these enhancements give you deeper insight, greater flexibility, and tighter control over your pipelines. In this session, you’ll learn exactly how to leverage assets and event-driven scheduling in Airflow 3, including:

• Defining asset-driven pipelines
• Adapting existing workflows if you previously used datasets
• Implementing real-time triggers with AWS SQS