Amazon SageMaker
Follow a step-by-step tutorial for using Airflow to orchestrate the training and testing of a SageMaker model.
Anyscale
Learn how to use the Anyscale provider package to orchestrate Ray jobs on Anyscale with Apache Airflow®.
Apache Kafka/Confluent
How to produce to and consume from Kafka topics using the Kafka Airflow provider
Azure Blob Storage
Learn how to create an Azure Blob Storage connection in Airflow.
Azure Container Instances
Learn how to orchestrate containers with Azure Container Instances from your Airflow DAGs.
Microsoft Entra Workload ID
Learn how to create an Azure Workload Identity connection in Airflow.
BigQuery
Learn how to create a BigQuery connection in Airflow.
Cohere
Learn how to integrate Cohere and Airflow.
Databricks
2 items
dbt Cloud
2 items
dbt Core
This page has not yet been updated for Airflow 3. The concepts shown are relevant, but some code may need to be updated. If you run any examples, take care to update import statements and watch for any other breaking changes.
DuckDB
Learn how to use DuckDB with Airflow.
Fivetran
Learn how to orchestrate Fivetran syncs using Airflow
Great Expectations
Orchestrate Great Expectations data quality checks with your Airflow DAGs.
Jupyter notebook
Run a parameterized Jupyter notebook using Airflow and the Astro CLI.
Marquez
Use OpenLineage and Marquez to get lineage metadata locally from your Airflow DAGs.
MLflow
How to use MLflow with Airflow in three different ways.
MongoDB
Learn how to load vector embeddings into MongoDB with Apache Airflow.
Microsoft SQL Server
Learn how to create a Microsoft SQL Server connection in Airflow.
OpenAI
Learn how to integrate OpenAI and Airflow.
OpenSearch
Learn how to integrate OpenSearch and Airflow.
pgvector
Learn how to integrate pgvector and Airflow.
Pinecone
Learn how to integrate Pinecone and Airflow.
Postgres
Learn how to create a Postgres connection in Airflow.
Qdrant
Learn how to integrate Qdrant and Airflow.
Ray
Learn how to use the Ray provider package to orchestrate Ray jobs with Apache Airflow®.
Redshift
2 items
Snowflake
3 items
Soda Core
Learn how to orchestrate Soda Core data quality checks with your Airflow DAGs.
Weaviate
Learn how to integrate Weaviate and Airflow.
Weights and Biases
Learn how to use Airflow and Weights and Biases to manage and visualize your ML model lifecycle.