Airflow in Action: How Panasonic Energy is Accelerating the EV Transition With Data Engineering
- M Matthew Keep
Learn how Panasonic leverages Apache Airflow to streamline battery production, scale workflows, and plan for streaming and Kubernetes.
Astronomer Blog
The latest insights from our team of Apache Airflow® experts.
ELT for Beginners: Extract from S3, Load to Databricks and Run Transformations
This blog post shows how you can create a best-practice daily ELT pipeline to move data from S3 into Databricks and run transformations defined in Databricks Notebooks.
Airflow in Action: ML and LLM Ops Insights from ASAPP — Reducing Workflow Runtimes by 85%
Discover how ASAPP turbocharges MLOps with Airflow and Spark, scaling LLM workflows to boost efficiency & achieve lightning-fast processing in hours vs days.
Airflow in Action: Infrastructure Management Insights from 1 Million Monthly Deploys at LinkedIn
Discover how LinkedIn uses Airflow to orchestrate 12k pipelines managing 1m deploys for 7k services. And Airflow 3.0 will make provisioning even easier!
Airflow in Action: Data Engineering Insights from Processing PBs of Data Every Day at Stripe
Learn how Stripe processes petabytes of data daily with Apache Airflow, ensuring compliance while accelerating developer workflows with its dev/test tooling
Airflow in Action: Scaling Insights from Bosch and 1.2 Million Pipeline Runs Per Day
Go on an Airflow journey with Bosch as they scale from 1k to 50k DAG runs per hour and 1.2 million pipeline runs per day with an average 1 second latency.
Customer Story: Autodesk’s Data Engineering Transformation with Astronomer and Apache Airflow
To keep pace with rapid growth and the increasing complexity of data workflows, Autodesk turned to Astro, powered by Apache Airflow, to transform their data engineering processes.
It Pays to be Picky: Leveraging Key Insights with Airflow and Astro
Here are four key observability insights to consider focusing on when setting up an observability solution: data freshness, on-time delivery, data dependencies tracking, and data quality.
Airflow in Action: Supercharging Data Science and ML Workflows At Apple
Learn how Apple uses Airflow to streamline experimentation with Jupyter Notebooks, boost productivity, and support large-scale, distributed ML workflows.
Airflow in Action: ETL Insights from Bloomberg — Slashing Runtimes by 50%
Learn why Bloomberg selected Airflow over Dagster and Prefect, reducing the ETL of 50 million loans and 5 billion data points by 50%
Airflow in Action: Data Engineering Insights from Burns & McDonnell
Discover how Burns & McDonnell scaled data delivery from ad-hoc workflows to a unified platform using Apache Airflow, providing reliable data in under 24 hours.
Update: Astro Observe is Now In Public Preview
Today, we’re excited to announce Astro Observe, which brings new and more robust data observability capabilities to users on Astro, OSS Airflow, Amazon Managed Workflows for Apache Airflow (MWAA), and Google Cloud Composer (GCC).
