Skip to main content

Manage DAG runs

As a data engineer or data scientist, you might need to view details about your DAGs' performance, including task logs, run status, and retries. You might additionally have to manually retry DAG runs or mark them as a specific status when troubleshooting any issues.

DAGs overview​

The DAGs page in the Astro UI lets you view all DAGs in your Workspace from a single place. You can view high level metrics about each DAG in a summary table.

To access the DAGs page, either click DAGs on the left sidebar or click DAGs on a Deployment's information page.

The DAGs page in the Astro UI, showing summary information for two DAGs

The DAGs page shows the following summary information about the DAG runs for all Deployments in your Workspace. You can filter through these DAGs using the left menu:

  • Total DAG runs over the last 14 days, expressed as a bar chart.

    Each bar in the chart represents an individual DAG run. A bar's color represents whether the DAG run was a success or a failure, while its length represents the total duration of the DAG run. If there are more than 14 DAG runs in the last 14 days, then the chart shows only the 14 most recent DAG runs.

  • State: Indicates whether the DAG is Active or Paused. If a DAG has a purple lightning symbol next to its name, that DAG is Active.

  • Last Run: The duration of the last DAG run and the ending time of the DAG's most recent DAG run, expressed relative to the current time.

  • Schedule: The frequency that the DAG runs and the starting time of the next DAG run, expressed relative to the current time.

  • Deployment: The Deployment ID of the Deployment for the current DAG Run.

  • Owner(s): The Airflow DAG owner attribute. You can change the owner attribute when you write or update your DAG.

  • Tags: The custom tags that you marked your DAG with. To add custom tags to a DAG, see Airflow documentation.

Access the Airflow UI for a Deployment​

Every Astro Deployment runs its own webserver and instance of the Airflow UI. If you want to manage your DAG and task runs through the Airflow UI, you can access it either through the Astro UI or the Astro CLI.

To access the Airflow UI for your Deployment in the Astro UI:

  1. In the Astro UI, open your Deployment.
  2. Click Open Airflow.

To access a Deployment's Airflow UI from the Astro CLI:

  1. Run the following command to retrieve the URL for the Deployment's Airflow UI:

    astro deployment inspect -n <deployment-name> -k metadata.webserver_url

  2. Copy the URL into a web browser and hit enter to directly open the Airflow UI for your Deployment.

Access the DAGs page in the Airflow UI​

  1. In the Astro UI, Click DAGs.
  2. Click Open in Airflow for the DAG that you want to manage.

Was this page helpful?