Astro Runtime release notes
Astro Runtime is a Docker image built and published by Astronomer that extends the Apache Airflow project to provide a differentiated data orchestration experience. This document provides a summary of changes made to each available version of Astro Runtime.
To upgrade Astro Runtime, see Upgrade Astro Runtime. For general product release notes, see Astro Release Notes. If you have any questions or a bug to report, contact Astronomer support.
Because Astronomer has separate maintenance life cycles for each major version of Astro Runtime, the same change can be introduced multiple times across major versions, resulting in multiple identical release notes. When a new major version releases, such as Astro Runtime 8.0.0, all changes from previously released versions are included in the new major version.
If you're upgrading to receive a specific change, ensure the release note for the change appears either:
- Within your target major version.
- In any minor or patch version that was released before the first release (
X.0.0
) of your target major version. For example, a change in Astro Runtime 9.9.0, which released January 10 2024, is not guaranteed to appear in Runtime 10.0.0, which released December 8 2023, unless there is a release note for it in a subsequent Runtime 10 patch. However, a change in Astro Runtime 9.6.0, which released November 30 2023, is guaranteed to exist in Runtime 10.0.0 because 9.6.0 was released prior to 10.0.0.
Astro Runtime 12.2.0
- Release date: October 16, 2024
- Airflow version: 2.10.2
Early access Airflow bug fixes
- Fixed a bug where the executor would not clean up terminated task instances that go too long without a heartbeat #43065
- Fixed a bug that caused
StaleDataError
by using a different session for writing and deleting recent task instance failures #42928
Additional improvements
- Scarf telemetry collected by Airflow is disabled by default.
Astro Runtime 12.1.1
- Release date: September 20, 2024
- Airflow version: 2.10.2
Additional improvements
- Upgraded to Airflow 2.10.2. See Airflow Release Notes for more information.
Astro Runtime 12.1.0
- Release date: September 6, 2024
- Airflow version: 2.10.1
Additional improvements
- Upgraded to Airflow 2.10.1. See Airflow Release Notes for more information.
- Updated the Airflow startup sequence to better isolate DAG authors.
- Upgraded the minor and patch versions of some open-source provider packages. See Astro Runtime 12.1.0 provider packages
Security fixes
- Fixed CVE-2024-45034
- Fixed CVE-2024-45498
Astro Runtime 12.0.0
- Release date: August 16, 2024
- Airflow version: 2.10.0
Airflow 2.10.0
Astro Runtime 12.0.0 includes same-day support for Apache Airflow 2.10, which includes a number of new features and improvements. Airflow 2.10 includes the following changes:
- Adds decorators for task flow (
@skip_if
,@run_if
) to make it easier to apply whether or not to skip a task. - You can now see
TaskInstance
Try History in the Airflow UI - Enable ending the task directly from the triggerer without going into the worker.
- Extended dataset dependencies to support dynamic Dataset Event Emission and Dataset Creation.
- A new object,
DatasetAlias
, is available to support dynamic Dataset Event Emission and Dataset Creation (#40478) - Implement accessors to read dataset events defined as inlet (#39367)
For more information about the major changes in this release, see the Airflow Blog or the Airflow release notes.
Additional improvements
- Updated OS to Debian 12.6 (bookworm)
- Updated Python version to 3.12 in default image
- Upgraded the minor and patch versions of some open-source provider packages. See Astro Runtime 12.0.0 provider packages
Behavior change
- Since Airflow 2.10 uses Python 3.12, some Python modules have reached end of life, like
imp
, that might create errors in your DAGs if you still use them. See Upgrade considerations: Runtime 12 for more information.
Astro Runtime 11.12.0
- Release date: October 25, 2024
- Airflow version: 2.9.3
Early access Airflow bug fixes
- Revert "Fix: DAGs are not marked as stale if the dags folder change" #42197
- Revert "Handle Example dags case when checking for missing files" #42193
Additional improvements
- Upgraded the minor and patch versions of several open-source provider packages. See Astro Runtime 11.12.0 provider packages
Astro Runtime 11.11.0
- Release date: October 3, 2024
- Airflow version: 2.9.3
Early access Airflow bug fixes
- Fixed a bug in the check served logs logic that caused the UI to show an erroneous 404 error if the user was looking at the logs for a non-running try #41272
- Fixed a bug where clicking on a
run_id
in atask_instance
ordag_run
list incorrectly opened a differentrun_id
#42138
Additional improvements
- Add logging around listener.
- Upgraded the minor and patch versions of several open-source provider packages. See Astro Runtime 11.11.0 provider packages
Astro Runtime 11.10.1
- Release date: September 6, 2024
- Airflow version: 2.9.3
Additional improvements
- Updated the Airflow startup sequence to better isolate DAG authors.
- Included open-source provider packages reference. See Astro Runtime 11.10.1 provider packages
Security fixes
- Fixed CVE-2024-45034
Astro Runtime 11.10.0
- Release date: September 2, 2024
- Airflow version: 2.9.3
Additional improvements
- Upgraded the minor and patch versions of several open-source provider packages. See Astro Runtime 11.10.0 provider packages
Bug fixes
- Resolved a DAG parsing issue where DAGs were not marked as stale if the
AIRFLOW__CORE__DAGS_FOLDER
was changed. (#41433) - LocalTaskJob no longer fails on heartbeat due to temporary database connection losses. (#41704)
Astro Runtime 11.9.0
- Release date: August 15, 2024
- Airflow version: 2.9.3
Additional improvements
- Downgrade
apache-airflow-providers-openlineage
to1.8.0
to prevent scheduler OOM with complex DAGs
Astro Runtime 11.8.0
- Release date: August 9, 2024
- Airflow version: 2.9.3
Additional improvements
- Fixed the Tasks API endpoint for scenarios when a DAG doesn't have a
start_date
(#40878) - Added validation for the project URL that comes from installed providers, before displaying the URL in views (#40933)
- Upgraded the minor and patch versions of some open-source provider packages. See Astro Runtime 11.8.0 provider packages
Astro Runtime 11.7.0
- Release date: July 17, 2024
- Airflow version: 2.9.3
Airflow 2.9.3
Astro Runtime 11.7.0 includes same-day support for Apache Airflow 2.9.3. Airflow 2.9.3 contains a number of bug fixes and new features including:
- The time unit for
scheduled_duration
andqueued_duration
metrics has changed to milliseconds instead of seconds #37936 - Support for OpenTelemetry metrics on Airflow are now considered Stable, and was previously added in Airflow version 2.7.0 as Experimental #40286
For more information, see the Apache Airflow release notes.
Additional improvements
- Upgraded the minor and patch versions of some Astro open source provider packages. See Astro Runtime 11.7.0 provider packages
Security fixes
- Fixed CVE-2024-6345
- Fixed CVE-2024-39863
- Fixed CVE-2024-39877
Astro Runtime 11.6.0
- Release date: June 28, 2024
- Airflow version: 2.9.2
Early access Airflow bug fixes
- Fixed a bug where FAB config options, such as
[fab] update_fab_perms
, were not checking for values in the deprecated webserver config section. For example,[webserver] update_fab_perms
(#40317)
Additional improvements
- Upgraded the minor and patch versions of some Astro open source provider packages. See Astro Runtime 11.6.0 provider packages
Astro Runtime 11.5.0
- Release date: June 11, 2024
- Airflow version: 2.9.2
Airflow 2.9.2
Astro Runtime 11.5.0 includes same-day support for Apache Airflow 2.9.2. Airflow 2.9.2 contains a number of bug fixes including:
- Resolved a bug where valid DAGs that worked in Airflow 2.8 and had outlet datasets with specific URIs stopped working depending on how the URI was formatted (#39670)
- Resolved an issue where the object storage XCOM backend did not serialize correctly, causing custom XCOM backends to sometimes fail (#39313)
For more information, see the Apache Airflow release notes.
Additional improvements
- Upgraded the minor and patch versions of some Astro open source provider packages. See Astro Runtime 11.5.0 provider packages
Security fixes
Astro Runtime 11.4.0
- Release date: May 28, 2024
- Airflow version: 2.9.1
Additional improvements
- Upgraded some OSS providers' minor and patch versions. See Astro Runtime 11.4.0 provider packages
- Added a centralized reference page with all OSS provider package versions listed for each Astro Runtime version. See Provider package reference
Astro Runtime 11.3.0
- Release date: May 6, 2024
- Airflow version: 2.9.1
Early access Airflow bug fixes
- Fixed a bug affecting custom actions in Airflow plugins that prevents users from running an Astro Runtime environment locally for Astro Runtime versions
11.0.0
-11.2.0
. Deployments running these versions on Astro are not affected. To continue using11.0.0
-11.2.0
locally, setAIRFLOW__ASTRONOMER__UPDATE_CHECK_INTERVAL=0
in your Astro project.env
file (#39421)
Additional improvements
- Upgraded some OSS providers' minor and patch versions
Security fixes
Astro Runtime 11.2.0
- Release date: April 26, 2024
- Airflow version: 2.9.0
Due to an issue related to using custom FAB actions in Airflow plugins, you might experience an error when you run this version of Astro Runtime locally using the Astro CLI. To resolve this issue, either upgrade directly to Astro Runtime 11.3.0 or set AIRFLOW__ASTRONOMER__UPDATE_CHECK_INTERVAL=0
in your Astro project .env
file.
Early access Airflow bug fixes
- Fixed a bug where
airflow db migrate
would throw an error (#39246)
Additional improvements
- Added the
apache-airflow-providers-mysql
provider - Upgraded some OSS providers' minor and patch versions
Security fixes
Astro Runtime 11.1.0
- Release date: April 19, 2024
- Airflow version: 2.9.0
Due to an issue related to using custom FAB actions in Airflow plugins, you might experience an error when you run this version of Astro Runtime locally using the Astro CLI. To resolve this issue, either upgrade directly to Astro Runtime 11.3.0 or set AIRFLOW__ASTRONOMER__UPDATE_CHECK_INTERVAL=0
in your Astro project .env
file.
Additional improvements
- Updated
sqlparse
to0.5.0
. - Upgraded Gunicorn to
22.0.0
. - Added functionality for using plugins to generate custom menu items in the Airflow UI. This feature will be fully available on Astro in a future release.
Astro Runtime 11.0.0
- Release date: April 8, 2024
- Airflow version: 2.9.0
Due to an issue related to using custom FAB actions in Airflow plugins, you might experience an error when you run this version of Astro Runtime locally using the Astro CLI. To resolve this issue, either upgrade directly to Astro Runtime 11.3.0 or set AIRFLOW__ASTRONOMER__UPDATE_CHECK_INTERVAL=0
in your Astro project .env
file.
Airflow 2.9.0
Astro Runtime 11.0.0 includes same-day support for Apache Airflow 2.9, which includes a number of new features and improvements. Airflow 2.9 includes the following changes:
- New data-aware scheduling lets you use conditional logic (AND / OR) to schedule DAGs.
- You can now create your own labels for dynamically mapped tasks with templates, which makes it easier to search through mapped task instances.
- External XCom backends can now be configured to use object storage.
- Delivered several significant improvements to the Airflow UI. For example, you can now filter, view, and create datasets through the Airflow UI.
- New Listener API methods are considered stable and suitable for use in production.
- Added the ability to automatically pause a DAG after a pre-defined number of sequentially failed runs.
- Dataset URIs are validated when you enter them, and must conform to the rules set in AIP-60. See the Dataset documentation for more information.
For more information about the major changes in this release, see the Airflow Blog or the Airflow release notes.
Upgrade to Python 3.12
Airflow now supports Python 3.12. However, Pendulum 2 does not support Python 3.12. If you upgrade to Python 3.12 and want to use Airflow, you also need to upgrade to Pendulum 3.
Refer to the Airflow release notes for more information about any limitations in Python 3.12 support.
Bug fixes
- Fixed a bug where after a task failed, and no longer exists in a DAG, you can now still access details about the DAG in the Grid View of the Airflow UI.
- Fixed a bug where Airflow would show
failed_upstream
when a dynamically mapped task wasskipped
. - In the Python task decorator, you can only have
None
as the default parameter for context parameters.
Astro Runtime 10.9.0
- Release date: June 13, 2024
- Airflow version: 2.8.4
Early access Airflow bug fixes
- Fixed an issue where Airflow might accidentally store dynamic content in a cache, possibly storing sensitive data (#39550)
Additional improvements
- Upgraded the minor and patch versions of some Astro open source provider packages. See Astro Runtime 10.9.0 provider packages
- Includes
astronomer-providers-logging
version 1.1.5.1
Security fixes
Astro Runtime 10.8.0
- Release date: April 18, 2024
- Airflow version: 2.8.4
Additional improvements
- Added functionality for using plugins to generate custom menu items in the Airflow UI. This feature will be fully available on Astro in a future release.
- Updated
sqlparse
to0.5.0
. - Upgraded Gunicorn to
22.0.0
.
Security fixes
Ignored CVEs
- CVE-2024-34069 The underlying vulnerability of this CVE is only relevant to a small set of use cases and scenarios, such as when hosting Airflow publicly on the internet, and is considered low risk for Astro and Software users. Because the resolution would require significant changes to Airflow and its dependencies, this CVE has not been addressed at this time.
Astro Runtime 10.7.0
- Release date: April 11, 2024
- Airflow version: 2.8.4
Early access Airflow bug fixes
- Load providers configuration when gunicorn workers start (#38795)
- Prevent large objects from being stored in the RTIF (#38094)
- Load
consuming_dags
attr eagerly before dataset listener (#36247) - Add "return" statement to "yield" within a while loop in core triggers (#38389)
- Improve ExternalTaskSensor Async Implementation (#36916)
Security fixes
Astro Runtime 10.6.0
- Release date: March 26, 2024
- Airflow version: 2.8.4
Airflow 2.8.4
Astro Runtime 10.6.0 includes same-day support for Apache Airflow 2.8.4. Airflow 2.8.4 contains a number of bug fixes including:
- Fix the serialization of DAGs with
start_date
in a fixed timezone, which could cause the scheduler to crash (#38139) - Fix a bug where the scheduler heartrate wasn't calculated correctly, the parameter needed to calculate scheduler heartrate has been corrected (#37992)
For more information, see the Apache Airflow release notes.
Additional improvements
- Upgraded
apache-airflow-providers-google
to version10.16.0
Security fixes
Astro Runtime 10.5.0
- Release date: March 11, 2024
- Airflow version: 2.8.3
Airflow 2.8.3
Astro Runtime 10.5.0 includes same-day support for Apache Airflow 2.8.3. Airflow 2.8.3 contains a number of bug fixes including:
- Fix external_executor_id being overwritten (#37784)
- Set parsing context dag_id in dag test command (#37606)
For more information, see the Apache Airflow release notes.
Security fixes
Astro Runtime 10.4.0
- Release date: February 26, 2024
- Airflow version: 2.8.2
Airflow 2.8.2
Astro Runtime 10.4.0 includes same-day support for Apache Airflow 2.8.2. Airflow 2.8.2 contains a number of bug fixes including:
- Base date for fetching DAG grid view must include selected run_id (#34887)
- Change AirflowTaskTimeout to inherit BaseException (#35653)
For more information, see the Apache Airflow release notes.