Component resources
Scheduler
The scheduler orchestrates Dag runs and task scheduling.Scaling considerations
- Add additional replicas for high availability.
- Increase memory for complex Dag dependencies.
- Set
safeToEvict: falseto prevent cluster autoscaler eviction.
Webserver
API server (Airflow 3+)
Dag processor (Airflow 2.3+, required in Airflow 3)
In Airflow 2, the Dag processor defaults to 0 replicas and must be explicitly enabled. In Airflow 3, the APC API automatically sets
dagProcessor.enabled: true and enforces a minimum of 1 replica regardless of configuration.Triggerer
Workers (Celery executor)
default queue. Size each other queue, and give it an optional worker range, in the queue itself. See Configure worker queues and Configure worker autoscaling.