Remote Execution Agent maintenance policy
Remote Execution Agent versioning
Astro Remote Execution Agent versions are released regularly and use semantic versioning. Astronomer ships major, minor, and patch releases of the Remote Execution Agent in the format of major.minor.patch
Each Remote Execution Agent minor version is maintained for 6 months from the release.
- Major versions are released for significant feature additions. Major versions are not guranteed to be backward compatible.
- Minor versions are released for functional changes. Minor releases are backward compatible.
- Patch versions are released for bug and security fixes that resolve unwanted behavior. Patch releases are backward compatible.
Bug fixes are delivered through new minor.patch
versions. If you report an issue with a maintained Astro Runtime image that is not on the latest minor.patch
version, Astronomer Support may ask you to upgrade to see if it resolves the issue.
You can find full information about releases in the Remote Execution Agent release notes.
The following table describes the naming conventions for the image tags, allowing you to specify particular versions or allow your environment to use the latest options. Astronomer recommends using a fixed tag, with the versions for the Runtime, Python, and Remote Execution Agent explicitly defined.
Tag Format | Description |
---|---|
<runtime_version>-python-<python_version>-astro-agent-x.y.z | Recommended configuration format. Fixed tag with specific Remote Execution Agent and Python versions |
<runtime_version> | Floating tag pointing to latest Remote Execution Agent and Python versions |
<runtime_version>-python-<python_version> | Floating tag pointing to latest Remote Execution Agent versions |
<runtime_version>-base | Base image without ONBUILD support |
<runtime_version>-python-<python_version>-base | Floating tag for base image without ONBUILD support |
<runtime_version>-python-<python_version>-astro-agent-x.y.z-base | Fixed tag with specific Remote Execution Agent and Python versions for base image |
Remote Execution Agent images are not currently compatible with the RHEL platform.
Helm Chart Versioning
Remote Execution Agent Helm chart versions follow the Remote Execution Agent versioning, which means that every Agent release has a corresponding reference Helm chart release, so that the versioning is coupled. This allows you to know which Remote Execution Agent Helm chart version to upgrade to for a particular version of the Agent.
Upgrade Considerations
The Remote Execution Agent is distributed as a Docker image through the Astro control plane registry, images.astronomer.cloud
, and includes a Runtime image with multi-Python version support for the Agent and your DAG processor. This allows you to run an image in the Execution Plane with all requirements for running DAG code and the program used by the Agent. It also means that there are three foundational components in your execution plane that can be upgraded to ensure your Remote Execution Agent works with the most up-to-date versions of Airflow and Astro resources:
- Remote Execution Agent version
- Runtime Version
- Python Version
Astronomer recommends upgrading your Orchestration and Execution planes separately.
For upgrading the Execution Plane, Astronomer also recommends upgrading the agent version, the runtime version, and the python version individually.
Remote Execution Agent image upgrade process
-
Update your Astro project Dockerfile with the new version of Astro Remote Execution Agent image.
-
Build your image and publish to your image registry.
-
Update your Remote Execution Agent's Helm
values.yaml
file with the location of your new image in your image registry for the following parameters:dagProcessor:
image: <image-url>
triggerer:
image: <image-url>
workers:
- name:
queues:
image: <image-url> -
Run the following
helm
command to upgrade your installation:helm upgrade astro-agent astronomer/astro-remote-execution-agent \
--namespace astro-agent \
--values values.yaml