Elastic Infrastructure at Scale | | |
High Availability Ensure the dependable delivery of mission-critical data pipelines with high availability schedulers. | | |
Scale to 0 Deployments Schedule zero-cost downtime to optimize development deployment cost savings. | | |
Tasked-Optimized Worker Queues Assign tasks to specific worker sets based on computational needs for optimized resource utilization. | | |
Dynamic Workers Workers automatically scale up, and back down to zero, based on the needs of your workloads. | | |
Astro API Enable programmatic interactions and provide schemas for updating infrastructure and managing access control. | | |
Set-up and Teardown Tasks Manage task resources with setup tasks for preparation and teardown tasks for dismantling, regardless of task success. | | |
Enhanced Developer Productivity | | |
Astro CLI Run, parse, debug, and test DAGs on a local machine in a dedicated environment. | | |
Cloud IDE Enable browser-based DAG writing, testing, and running while automating DAG generation to reduce boilerplate code. | | |
Branch-Based Deploys Create isolated development environments for running, testing, and deploying your DAGs. | | |
CI/CD Automate reliable code deployment, enforce reviews, promote code across environments, and ensure testing. | | Limited |
The Astronomer Registry Easily explore and use supported providers, modules, example DAGs, and tools within the Airflow ecosystem. | | |
Increased Operational Efficiency | | |
Advanced Connection Management Streamline Airflow connections setup in a centralized location with a built-in, native solution provided by a secrets backend. | | |
Deployment Rollbacks Easily revert your Airflow deployments to any previous code deployment, allowing you to quickly undo any problematic changes made to your deployment. | | |
Multi-Tenant Airflow Empower teams to efficiently manage their own isolated Airflow environments, maximizing resource utilization and operational efficiency. | | |
In-Place Airflow Upgrades Upgrade Airflow while preserving DAGs, configurations, and data to minimize downtime and data loss risks. | | |
Cosmos Execute dbt Core within Airflow, transforming projects into Task Groups or complete DAGs. | | |
Upgrade Utilities Proactively identify and address common pitfalls and issues post-upgrade. | | |
Visibility and Reporting | | |
Cross Deployment Visibility + Health Gain complete visibility of your DAGs and metadata across all of your Airflow deployments. | | |
Data-Centric Alerting Configure alerts based on DAG run and task states, receiving real-time notifications for proactive monitoring. | | |
Listeners Write custom code that executes when specific events occur anywhere in your Airflow instance. | | |
Lineage Visualize task relationships and track data movement within workflows, including data movement in external systems. | | Limited |
Organizational Reporting Get a comprehensive overview of resource usage across all Workspaces in your organization. | | |
Robust Enterprise-Grade Security | | |
Role-Based Access Control (RBAC) Implement granular, role-based access control across workspaces, teams, and deployments. | | Limited |
Multi-Tenancy Collaborate within isolated spaces by utilizing workspaces and deployments for your DAGs. | | |
Private Networking Establish secure connections by VPC peering directly with your private networks. | | |
Compliance Readiness Meet SOC 2, GDPR, HIPAA, and PCI DSS security standards compliance. | | |
Secrets Management Automate secret management across Airflow deployments, ensuring a unified interface for seamless handling of secrets. | | |
Encryption Automatically encrypts all data, both at rest and in transit, including databases, file systems, and network transmissions. | | |
Committer-led Support | | |
24x7x365 Support Access to the world's leading Airflow experts and committers. | | |
Professional Services Customize hands-on engagements to achieve your goals. | | |
Education, Enablement, and Certification Build Airflow expertise across your organization with diverse training and certification options. | | |