Apache Release Notes

📦 PyPI: https://pypi.org/project/apache-airflow/3.1.2/ 📚 Docs: https://airflow.apache.org/docs/apache-airflow/3.1.2/ 🛠 Release Notes: https://airflow.apache.org/docs/apache-airflow/3.1.2/release_notes.html 🐳 Docker Image: "docker pull apache/airflow:3.1.2" 🚏 Constraints: https://github.com/apache/airflow/tree/constraints-3.1.2

Significant Changes

No significant changes.

Bug Fixes

• Fix import error when upgrading structlog to 25.5.0+ (#57335)
• Fix connection retrieval in DagProcessorManager for bundle initialization (#57459)
• Fix incorrect task instance counts displayed in task group headers (#55670)
• Fix task retry execution after tasks are killed by external signals (#55767)
• Fix triggerer errors after Airflow 2 to 3 migration (#55884)
• Fix tasks unable to access triggering_user_name context variable (#56193)
• Fix outlet event extra data being empty in task instance success listener callbacks (#57031)
• UI: Fix panel button spacing and alignment issues (#57062)
• UI: Fix broken grid view links for tasks with retries (#57097)
• Fix DAG processor crash when renaming DAG tag case on MySQL (#57113)
• Fix iteration errors when using ObjectStoragePath (#57156)
• Fix auto-refresh not working on Required Actions page (#57207)
• Fix DAG processor crash by ignoring callbacks from other bundles (#57330)
• Fix asset name text overflow in DAG list view (#57363) …

📦 PyPI: https://pypi.org/project/apache-airflow/3.1.1/ 📚 Docs: https://airflow.apache.org/docs/apache-airflow/3.1.1/ 🛠️ Release Notes: https://airflow.apache.org/docs/apache-airflow/3.1.1/release_notes.html 🪶 Sources: https://airflow.apache.org/docs/apache-airflow/3.1.1/installation/installing-from-sources.html 🐳 Docker Image: "docker pull apache/airflow:3.1.1" 🚏 Constraints: https://github.com/apache/airflow/tree/constraints-3.1.1

Bug Fixes

• Fix execution failures with NULL dag_run.conf during upgrades from earlier versions (#56729)
• Fix memory leak in remote logging connection cache (#56695)
• Fix DAG processor crash with pre-import module optimization enabled (#56779)
• Fix scheduler crash with email notifications (#56431)
• Fix scheduler crash during 3.0 to 3.1 migration when retry_delay is None (#56236)
• Fix task retries executing wrong method after deferred state (#56737)
• Fix retry callbacks not executing for externally killed tasks (#56607)
• Fix custom timetable generate_run_id not called for manual triggers (#56699)
• Fix KeyError when accessing retry_delay on MappedOperator without explicit value (#56605)
• Fix task-sdk connection error handling to match airflow-core behavior (#56653)
• Fix topological sort for Grid View (#56963)
• Fix get_ti_count and get_task_states access in callback requests (#56860)
• Fix Connection or Variable access in Server context (#56602) …

We are thrilled to announce the release of Apache Airflow 3.1.0, an update that puts humans at the center of data workflows.

Read more about what 3.1.0 brings in https://airflow.apache.org/blog/airflow-3.1.0/

📦 PyPI: https://pypi.org/project/apache-airflow/3.1.0/
📚 Core Airflow Docs: https://airflow.apache.org/docs/apache-airflow/3.1.0/
📚 Task SDK Docs: https://airflow.apache.org/docs/task-sdk/1.1.0/
🛠️ Release Notes: https://airflow.apache.org/docs/apache-airflow/3.1.0/release_notes.html
🚏 Constraints: https://github.com/apache/airflow/tree/constraints-3.1.0

Apache Airflow 3.1.0 represents an extraordinary community effort, showcasing the vibrant ecosystem that drives this project forward with 163 contributors making this release possible across 1,400+ commits.

Screenshots

i18n-demo snake calendar <img width="1600" height="775" alt="favorite" src="https://github.com/user-attachments/assets/0dec07d2-56b6-4b02-adcc-6431d89fa52c" /> <img width="1871" height="1118" alt="gantt" src="https://github.com/user-attachments/assets/3a53106f-352c-477c-9398-f2f7c5ae8b16" /> hitl

New Features …

📦 PyPI: https://pypi.org/project/apache-airflow/3.0.6/ 📚 Docs: https://airflow.apache.org/docs/apache-airflow/3.0.6/ 🛠️ Release Notes: https://airflow.apache.org/docs/apache-airflow/3.0.6/release_notes.html 🪶 Sources: https://airflow.apache.org/docs/apache-airflow/3.0.6/installation/installing-from-sources.html 🐳 Docker Image: "docker pull apache/airflow:3.0.6" 🚏 Constraints: https://github.com/apache/airflow/tree/constraints-3.0.6

Bug Fixes

• Fix Connection extra field masking errors when connections use masked values (#54780)
• UI: Fix TriggerDagRunLink broken page when clicking "Triggered DAG" button (#54760)
• Fix remote logging connection availability in Task SDK supervisor when connections are created via UI (#54720)
• Fix task_queued_timeout not working after first DAG run by properly resetting queued_by_job_id (#54604)
• Fix DAG version determination to use bundle path and relative fileloc instead of absolute fileloc (#54483)
• Remove Kerberos replay cache (KRB5CCNAME env) when running tasks with user impersonation (#54672)
• Skip additional span-related database queries when tracing is disabled (#54626)
• Fix max_active_tasks persisting after removal from DAG code (#54639)
• UI: Automatically switch to the triggered DAG run in Graph/Grid view when manually triggering a DAG run (#54336)
• UI: Fix "Maximum update depth exceeded" errors in Task Log Preview by filtering out empty log entries (#54628) …

What's Changed

📦 PyPI: https://pypi.org/project/apache-airflow/3.0.5/ 📚 Docs: https://airflow.apache.org/docs/apache-airflow/3.0.5/ 🛠️ Release Notes: https://airflow.apache.org/docs/apache-airflow/3.0.5/release_notes.html 🪶 Sources: https://airflow.apache.org/docs/apache-airflow/3.0.5/installation/installing-from-sources.html 🐳 Docker Image: "docker pull apache/airflow:3.0.5" 🚏 Constraints: https://github.com/apache/airflow/tree/constraints-3.0.5

Bug Fixes

• UI: Fix JSON field display in dark mode when using system OS theme detection (#54260)
• Restore proper DAG callback execution context (#53684)
• Restore get_previous_dagrun functionality for task context (#53655)
• Fix scheduler crashes with DetachedInstanceError when processing executor events (#54334)
• Fix DetachedInstanceError when accessing DagRun.created_dag_version (#54362)
• Fix Task SDK to respect custom default queue configuration from config settings (#52786)
• Fix: Cannot edit or delete pools with "/" in the name in the UI (#54268)
• Fix: Validate and handle invalid extra field in connections UI and API (#53963, #54034, #54235)
• Fix: Apply DAG permission filter to dashboard (#54215)
• Fix API validation error when DAG runs have bundle_version but no created_dag_version (#54010)
• Fix task configuration defaults not being read from configuration settings (#52871) …

What's Changed

📦 PyPI: https://pypi.org/project/apache-airflow/3.0.4/ 📚 Docs: https://airflow.apache.org/docs/apache-airflow/3.0.4/ 🛠️ Release Notes: https://airflow.apache.org/docs/apache-airflow/3.0.4/release_notes.html 🪶 Sources: https://airflow.apache.org/docs/apache-airflow/3.0.4/installation/installing-from-sources.html 🐳 Docker Image: "docker pull apache/airflow:3.0.4" 🚏 Constraints: https://github.com/apache/airflow/tree/constraints-3.0.4

Bug Fixes

• Fix scheduler heartbeat timeout failures with intermittent DetachedInstanceError crashes (#53838) (#53858)
• Fix connection editing where sensitive fields like passwords and extras were lost when updating connections (#53943) (#53973)
• Fix BaseOperator on_kill functionality not working when tasks are killed externally in TaskSDK (#53718) (#53832)
• Fix TaskInstance notes not refreshing automatically without manual page refresh (#53307) (#54025)
• Fix invalid execution API URLs causing failures in task supervisor (#53082) (#53518)
• Fix task failure callbacks not running on DAG Processor when tasks are externally killed (#53058) (#53143)
• Fix task_success_overtime configuration option not being configurable (#53342) (#53351)
• Fix CSS warning for nth-child selector (#53982) (#54000)
• Fix DAG filtering where "all" option did not show all DAGs as expected (#53656) (#53672)
• Fix accordion child contents not being visible when content overflows (#53595) (#53602) …

What's Changed

📦 PyPI: https://pypi.org/project/apache-airflow/3.0.3/ 📚 Docs: https://airflow.apache.org/docs/apache-airflow/3.0.3/ 🛠️ Release Notes: https://airflow.apache.org/docs/apache-airflow/3.0.3/release_notes.html 🪶 Sources: https://airflow.apache.org/docs/apache-airflow/3.0.3/installation/installing-from-sources.html 🐳 Docker Image: "docker pull apache/airflow:3.0.3" 🚏 Constraints: https://github.com/apache/airflow/tree/constraints-3.0.3

Bug Fixes

• Fix task execution failures with large data by improving internal communication protocol (#51924, #53194)
• Fix reschedule sensors failing after multiple re-queue attempts over long periods (#52706)
• Improve xcom_pull to cover different scenarios for mapped tasks (#51568)
• Fix connection retrieval failures in triggerer when schema field is used (#52691)
• Add back user impersonation (run_as_user) support for task execution (#51780)
• Fix DAG version not updating when bundle name changes without DAG structure changes (#51939)
• Add back exception to context for task callbacks (#52066)
• Fix task log retrieval for retry attempts showing incorrect logs (#51592)
• Fix data interval handling for DAGs created before AIP-39 during serialization (#51913)
• Fix lingering task supervisors when EOF is missed (#51180) (#51970)
• Persist EventsTimetable's description during serialization (#51926)
• Delete import error when a dag bundle becomes inactive (#51921) …

Significant Changes

No significant changes.

Improvements

• Allow ConfigMap and Secret references in apiServer.env (#51191)
• Add custom annotations to JWT Secret (#52166)
• Allow valuesFrom in gitSync.env (#50228)

Bug Fixes

• Fix JWT secret name (#52268)
• Use api-server instead of webserver in NOTES.txt for Airflow 3.0+ (#52194)
• Change default executor in pod template to support executor parameter in task (#49433)
• Use merged to render airflow.cfg and include computed defaults (#51828)
• Use [api] secret_key for Airflow 3.0+ instead of [webserver] secret_key (#52269)
• Fix for fernetkey and add test of its value (#52977)

Doc only changes

• Update supported executors in docs (#52132)
• Update service name for port-forward of Airflow UI (#51945)

Significant Changes

Default Airflow image is updated to 3.0.2 (#51594)

The default Airflow image that is used with the Chart is now 3.0.2, previously it was 2.10.5.

New Features

• Add extra secret annotations to most secrets (#48890)
• Add support for EdgeExecutor (#50897)

Improvements

• Unify k8s labels & add some missing k8s labels (#49522)

Bug Fixes

• Fix missing api server ingress (#49727)
• Replace break function in pod-launcher-rolebinding template (#49219)
• Add webserver_config.py file to api-server (#50108)
• Declare missing API server properties (#51012)
• Add missing api server replicas parameter (#50814)
• Fix FAB enable_proxy_fix default for Airflow 3 (#50056)
• Add the dag processor ServiceAccount to SecurityContextConstraints role binding (#51080)
• Generate JWT secret during HELM install (#49923)
• Always deploy JWT secret (#51799)
• Add missing workers.kerberosInitContainer configuration in values (#51405)
• Truncate the executor label length (#51817)
• Fix execution_api_server_url when base_url has a subpath (#51454)

Doc only changes

• Bump minimum helm version in docs (#48700)
• Clarify which worker fields apply to Celery and Kubernetes worker pods (#50458)
• Capitalize the term airflow (#49450)
• Add EdgeExecutor to readme (#51017)
• Add 3.X/2.X clarification for CeleryKubernetesExecutor (#49916)

Misc …

What's Changed

📦 PyPI: https://pypi.org/project/apache-airflow/3.0.2/ 📚 Docs: https://airflow.apache.org/docs/apache-airflow/3.0.2/ 🛠️ Release Notes: https://airflow.apache.org/docs/apache-airflow/3.0.2/release_notes.html 🪶 Sources: https://airflow.apache.org/docs/apache-airflow/3.0.2/installation/installing-from-sources.html

Bug Fixes

• Fix memory leak in dag-processor (#50558)
• Add back invalid inlet and outlet check before running tasks (#50773)
• Implement slice on LazyXComSequence to allow filtering items from a mapped task(#50117)
• Fix execution API server URL handling for relative paths in KE (#51183)
• Add log lookup exception for Empty operator subtypes (#50325)
• Increase the max zoom on the graph view to make it easier to see small dags on big monitor screens (#50772)
• Fix timezone selection and dashboard layout (#50463)
• Creating backfill for a dag is affecting other dags (#50577)
• Fix next asset schedule and dag card UX (#50271)
• Add bundle path to sys.path in task runner (#51318)
• Add bundle path to sys.path in dag processor (#50385)
• Prevent CPU spike in task supervisor when heartbeat timeout exceeded (#51023)
• Fix Airflow Connection Form widget error (#51168)
• Add backwards compatibility shim and deprecation warning for EmailOperator (#51004)
• Handle SIGSEGV signals during DAG file imports (#51171)
• Fix deferred task resumption in dag.test() (#51182) …