The Astronomer Blog: Data Orchestration Insights & Guides

November 28, 2023

Accelerating ML Application Development: Production-Ready Airflow Integrations with Critical AI Tools

Build production-ready ML applications with Airflow's integrations for LLMs and AI.

November 15, 2023

Introducing Apache Airflow® on Astro – an Azure Native ISV Service

Introducing Apache Airflow® on Astro, an Azure Native ISV Service. This partnership with Microsoft seamlessly embeds Apache Airflow® into the Azure ecosystem, offering a unified environment for scalable, secure, and easy-to-manage mission-critical data pipelines.

November 2, 2023

Apache Airflow® TaskFlow API vs. Traditional Operators: An In-Depth Comparison for Efficient DAGs

Explore the TaskFlow API and traditional operators and find out how to combine them for dynamic, efficient DAGs.

October 31, 2023

Orchestrating Feature Pipelines: Announcing the Tecton Airflow Provider

See how the new Tecton Airflow Provider can make your feature pipeline orchestration within Apache Airflow® more efficient.

October 24, 2023

Ask Astro: Operationalizing Data Ingest for Retrieval Augmented Generation with LLMs, Part 3

Data ingestion for RAG with LLMs: Ask Astro Part 3 covers vector stores, schema design, and chunking.

October 12, 2023

Using Astronomer’s new Cosmos to deploy dbt pipelines onto Snowflake

The state of deploying pipelines with dbt has changed considerably in the last few months. Over the last few weeks, I was working with Astronomer to test out their new tool, Cosmos, to deploy dbt workflows onto Snowflake.

October 11, 2023

Databricks vs. Airflow From a Management Perspective, Part 2

Databricks vs Airflow from a production management perspective. Explore the differences in setup, monitoring, integrations, scalability & customization.