Astro Observe is Now Generally Available
The new standard for pipeline reliability and data product observability.
Astronomer Blog
The latest insights from our team of Apache Airflow® experts.
FreightWaves scales Data Engineering with Astronomer and Apache Airflow
FreightWaves transitioned from a scattered and inefficient setup to Astronomer’s Astro, powered by Apache Airflow, to transform their data engineering practices.
Airflow in Action: Insights From Scaling Multiple Workloads Across A Shared Environment at Rakuten Kobo
Discover Rakuten Kobo’s strategies for scaling Airflow usage across teams, fostering collaboration with guardrails, alerts, and shared environments.
Airflow in Action: $160BN in Assets, 4,000 Data Pipelines. Financial Workflow Insights from Robinhood
Learn how Robinhood scaled mission-critical financial workflows with Airflow, from trading to clearing, migration strategies, and future plans.
Airflow in Action: Model Training with PBs of New Data Weekly. DataOps & MLOps Insights from Ford
Learn how Ford’s Mach1ML platform, powered by Airflow and Astronomer, delivers scalable, efficient MLOps for AI-driven innovation and next-gen vehicles.
Airflow in Action: DataOps Insights from 2,200 Pipelines at Instacart
Discover how Instacart scaled Apache Airflow to handle 2,200 pipelines and 16 million tasks monthly with custom tools, IaC, and centralized management.
Airflow in Action: ML and Data Engineering Insights from the Analytics-Obsessed World of MLB
Explore how the Texas Rangers and Philadelphia Phillies use Airflow to revolutionize data orchestration and ML, driving faster insights and a competitive edge.
Data Observability 101: An Introduction to the Most Critical Features of Modern Data Observability
When data is your product, your pipelines are supply chains.
Airflow in Action: How Panasonic Energy is Accelerating the EV Transition With Data Engineering
Learn how Panasonic leverages Apache Airflow to streamline battery production, scale workflows, and plan for streaming and Kubernetes.
ELT for Beginners: Extract from S3, Load to Databricks and Run Transformations
This blog post shows how you can create a best-practice daily ELT pipeline to move data from S3 into Databricks and run transformations defined in Databricks Notebooks.
Airflow in Action: ML and LLM Ops Insights from ASAPP — Reducing Workflow Runtimes by 85%
Discover how ASAPP turbocharges MLOps with Airflow and Spark, scaling LLM workflows to boost efficiency & achieve lightning-fast processing in hours vs days.
Airflow in Action: Infrastructure Management Insights from 1 Million Monthly Deploys at LinkedIn
Discover how LinkedIn uses Airflow to orchestrate 12k pipelines managing 1m deploys for 7k services. And Airflow 3.0 will make provisioning even easier!
