Exploring the Power of Airflow 3 at Astronomer with Amogh Desai

What does it take to go from fixing a broken link to becoming a committer for one of the world’s leading open-source projects?

Amogh Desai, Senior Software Engineer at Astronomer, takes us through his journey with Apache Airflow. From small contributions to building meaningful connections in the open-source community, Amogh’s story provides actionable insights for anyone on the cusp of their open-source journey.

Key Takeaways:

• (02:09) Building data engineering platforms at Cloudera with Kubernetes.
• (04:00) Brainstorming led to contributing to Apache Airflow.
• (05:17) Starting small with link fixes, progressing to Breeze development.
• (07:00) Becoming a committer for Apache Airflow in September 2023.
• (09:51) The steep learning curve for contributing to Airflow.
• (16:30) Using GitHub’s “good-first-issue” label to get started.
• (18:15) Setting up a development environment with Breeze.
• (22:00) Open-source contributions enhance your resume and career.
• (24:51) Amogh’s advice: Start small and stay consistent.
• (28:12) Engage with the community via Slack, email lists and meetups.

Resources Mentioned:

• Amogh Desai
• Astronomer
• Apache Airflow GitHub Repository
• Contributors Quick Guide
• Breeze Development Tool

Thanks for listening to “The Data Flowcast: Mastering Airflow for Data Engineering & AI.” If you enjoyed this episode, please leave a 5-star review to help get the word out about the show. And be sure to subscribe so you never miss any of the insightful conversations.

#AI #Automation #Airflow #MachineLearning