Pipelines: Airflow 3, and a view of your cluster you can rely on
The Pipelines screens now work with Apache Airflow 3 as well as Airflow 2, and say plainly what they know. Freshness is judged by one rule everywhere, and a scheduled run that never fired is reported.
- Airflow 3.0 and 3.1 are supported alongside Airflow 2, for reading runs and for the actions you approve.
- Task logs open in the product, showing the end of the log, where the failure is.
- One freshness rule across data assets, data products, ingestions and the agent. A model with no schedule says so.
- Missed scheduled runs are shown on the Schedules and Runs pages and raise one alert per outage.
- The stored cluster credential is sent only to the address it was saved for.