See why data quality is a valuable part of data systems and how to get started integrating data quality checks into existing pipelines with various tools.
Learn about DAG scheduling in Airflow and see how to define schedule intervals. Understand the difference between cron expressions and timedelta objects.
In this informative webinar we will cover everything you need to know about Airflow 2.2. We'll go through all of the new features large and small, as well as show you how to leverage all of the new features and how you can get cleaner and more efficient DAGs as a result
Join our webinar and find out how to test Airflow code and integrate tests in a CI/CD pipeline to ensure your code works before deploying to production.
In this webinar our experts show how to properly set up dependencies and define an order of execution or operation for your pipelines using dependencies.
Do you use Sensors in your data pipelines? Do you need to wait for a file before executing the next step? Are you looking to execute your task after a task completes in another DAG? Would you like to wait for an import in your SQL table before executing the next task?
Anytime you’re running business critical pipelines, you need to know when something goes wrong. Airflow has a built in notification system that can be used to throw alerts when your DAGs fail, succeed, or anything in between. In this webinar, we’ll do a deep dive into how you can customize your notifications in Airflow to meet your needs.