Repository navigation
Status of testing of Apache Airflow 3.0.3rc2 #52746
Description
We are kindly requesting that contributors to Apache Airflow RC 3.0.3rc1 help test the RC.
Please let us know by commenting if the issue is addressed in the latest RC.
- Add ti information to requeue logs (#49995): @karenbraganz
- Upgrade
flask-appbuilderto 4.6.3 in FAB provider (#50513): @potiuk @vincbeck
Linked issues: - Change v1 to v2 in generated OpenAPI schema files (#50705): @kaxil
- Fix the version for generated client (#50859): @kaxil
- [v3-0-test] Structure endpoint attach downstream asset to task level (#51401) (#51425): @pierrejeambrun
- fix(migrations): from 2.7.0 to 3.0.0 for SQLite (#51431): @Lee-W
- [v3-0-test] Fix http exception when ti not found for extra links API (#51443) (#51465): @amoghrajesh
- Make
dag.testconsistent withairflow dags testCLI command (#51476): @kaxil - [v3-0-test] Bring back mapped task extra links test (#51297) (#51477): @amoghrajesh
- [v3-0-test] Stop streaming task logs if end of log mark is missing (#50715) (#51482): @jedcunningham
- [v3-0-test] Fix structure edges (#51484) (#51489): @pierrejeambrun
- Improve
xcom_pullto cover different scenarios for mapped tasks (#51568): @amoghrajesh @uranusjr
Linked issues: - [v3-0-test] Minor fix in python client docs (#51216) (#51571): @dheerajturaga @pierrejeambrun
- [v3-0-test] Update docs for Python client (#50850) (#51572): @kaxil @pierrejeambrun
- [v3-0-test] Sync python client readme (#51573): @r-richmond @pierrejeambrun
- [v3-0-test] Structure endpoint task level resolved aliases (#51481) (#51579): @pierrejeambrun
- [v3-0-test] Pass dag_run_conf form value to backfill payload. (#51577) (#51584): @pierrejeambrun @tirkarthi
- [v3-0-test] Add git binary to PROD docker image (#51580) (#51587): @potiuk
- Support TaskInstanceHistory in log handlers (#51592): @sunank200
- [v3-0-test] Exclude libcst 1.8.1 for Python 3.9 (#51606) (#51609): @Lee-W
- [v3-0-test] Rename
lenin GetXComCount processing toxcom_count(#51611) (#51612): @amoghrajesh - [v3-0-test] Use Connection Hook Names for Dropdown instead of connection IDs (#51599) (#51613): @jscheffl
- [v3-0-test] Add config setting to control exposing stacktraces (#51509) (#51617): @kevinhongzl @pierrejeambrun
- [v3-0-test] Refactor
structuredLogstructure and layout (#51567) (#51626): @guan404ming - [v3-0-test] fix(migrations): only ignore value error when interacting with constraints in sqlite (#51529) (#51641): @Lee-W
- [v3-0-test] Fix PR number on 3.0.2 release note entry (#51637) (#51642): @potiuk @jedcunningham
- [v3-0-test] Explicitly close log file descriptor in the supervise function (#51627) (#51654): @adilkhash
- [v3-0-test] Move asset events to its own tab (#51625) (#51655): @pierrejeambrun
- [v3-0-test] Fix Jinja2 Template deep copy error with
dag.test(#51670) (#51673): @kaxil - [v3-0-test] Optimize ui lint pre-commits (#51725) (#51729): @potiuk
- [v3-0-test] Do not modify openapi-gen generated files by pre-commits … (#51757): @potiuk
- [v3-0-test] Add note about payload size considerations in API docs (#51732) (#51768): @amoghrajesh
- Add user impersonation (
run_as_user) support for task execution (#51780): @amoghrajesh @ashb - [v3-0-test] Reset table offset when DagFiltering changes (#51694) (#51795): @pierrejeambrun
- [v3-0-test] Remove outdated code comments from task runner (#51782) (#51798): @amoghrajesh
- [v3-0-test] Set proper version of the default images in the docs (#51822) (#51824): @potiuk
- [v3-0-test] Remove unnecessary logs while retrieving connections / variables (#51786) (#51826): @amoghrajesh
- [v3-0-test] Removing duplicate patching of supervisor_comms (#51870) (#51872): @amoghrajesh
- [v3-0-test] Fix EOF dection of subprocesses in Dag Processor (#51885) (#51895): @ashb
Linked issues: - [v3-0-test] fix(serialized_objects): try to infer data interval if it's none (#51530) (#51913): @Lee-W
- [v3-0-test] Swap 'connections_test' CLI to use Connection instead of BaseHook (#51834) (#51917): @amoghrajesh
- [v3-0-test] Cleanup import errors during DB migration (#51919): @ephraimbuddy
Linked issues: - [v3-0-test] Delete import error when a dag bundle becomes inactive (#51800) (#51921): @ephraimbuddy
- [v3-0-test] Switch the Supervisor/task process from line-based to length-prefixed (#51699) (#51924): @ashb
- [v3-0-test] Persist EventsTimetable's description during serialization (#51203) (#51926): @kacpermuda
- Fixing badly written test for user impersonation (#51927): @amoghrajesh
- Improve logging with
run_as_userto avoid "double" logging/plain-text-over-stdout (#51934): @amoghrajesh @ashb
Linked issues: - [v3-0-test] Update dag version when bundle name changes (#51901) (#51939): @vatsrahul1001 @ephraimbuddy
Linked issues: - Fix archival for cascading deletes by archiving dependent tables first (#51952): @vatsrahul1001 @jedcunningham
- [v3-0-test] Fix lingering task supervisors when
EOFis missed (#51180) (#51970): @kaxil - [v3-0-test] When UI files change in PR we build CI image / run all st… (#52012): @potiuk
- [v3-0-test] Enhance ENV vars and conns visibility docs. (#52014) (#52026): @simi
- [v3-0-test] Add exception to context for task callbacks (#52055) (#52066): @uranusjr
- [v3-0-test] Use explicit directives instead of implicit syntax (#50870) (#52068): @potiuk @uranusjr
- [v3-0-test] Fix Task Instance “No Status” Filter (#51880) (#52154): @sunank200
- [v3-0-test] Use run_backwards from the form value while creating backfill. (#49413) (#52168): @tirkarthi
- [v3-0-test] fix mypy errors in otel_tracer (#52170) (#52175): @xBis7
- [v3-0-test] Doc update to install git in docker image prior 3.0.2 (#5… (#52200): @dheerajturaga @potiuk
- [v3-0-test] Fix whitespace handling in DAG owners parsing for multipl… (#52221): @potiuk @choo121600
- [v3-0-test] Add more diagnostics for Airflow installation inside CI i… (#52232): @potiuk
- [v3-0-test] Set downstream option to default on task instance clear (#52130) (#52246): @humit0
- [v3-0-test] Skip test that needs the .git folder when it is missing (#52305) (#52308): @potiuk
- [v3-0-test] Python versions in shell params are strings (#52306) (#52309): @potiuk
- [v3-0-test] fix: task-sdk AssetEventOperations.get to use alias_name when specified (#52303) (#52324): @jharriman
- [v3-0-test] Fix indexerror in _find_caplog_in_def selective check function (#52369) (#52371): @gopidesupavan
- [v3-0-test] Add new
breeze runcommand for non-interactive command execution (#52370) (#52373): @kaxil - [v3-0-test] Add Python <=> Airflow compat filtering for breeze (#52386) (#52390): @amoghrajesh
- [v3-0-test] Run release tests always - not only in canary runs (#52389) (#52393): @potiuk
- [v3-0-test] Bump uv to 0.7.16 (#52405): @kaxil @potiuk
- [v3-0-test] Limit click back to 8.2.0 because it has an ENVVAR bug for flags (PR #52404) (#52409): @potiuk
- [v3-0-test] enhance error message for
breeze --backend noneto sugg… (#52410): @potiuk @kyungjunleeme - [v3-0-test] Adding some intelligence to classifying provider commits (#52407) (#52412): @amoghrajesh
- feat: Add real-time clock updates to timezone selector (#52414): @choo121600
- Make v3-0-test green (#52420): @potiuk
- [v3-0-test] Sanitize Username (#52419) (#52421): @SCH227
- [v3-0-test] Reduce timeout for task-sdk/airflow-ctl tests job workflow (#52399) (#52427): @gopidesupavan
- [v3-0-test] Skip check-airflow-providers-bug-report-template in non main branch #52426) (#52429): @gopidesupavan
- [v3-0-test] Add keycloak to providers removed when running Airflow 2 (#52442) (#52444): @potiuk
- [v3-0-test] Fix editing connection with sensitive extra field (#52403) (#52445): @shubhamraj-git @jscheffl
- [v3-0-test] Improve terminal handling for breeze commands (#52452) (#52456): @potiuk
- [v3-0-test] Speed-up constraints generation (#52449) (#52460): @potiuk
- [v3-0-test] Wire-in dependency check script in CI "finalize" job (#52… (#52461): @potiuk
- [v3-0-test] Fix generate-constraints run on different python than base (#52464) (#52466): @potiuk
- [v3-0-test] Add GITHUB_TOKEN when preparing image for dependency summary (#52472) (#52473): @potiuk
- [v3-0-test] Rmeove --tty specification for running the dependency script (#52489) (#52490): @potiuk
- [v3-0-test] Filter only provided integration paths for breeze integration testing (#52491): @gopidesupavan
- Backport e455329 v3 0 test (#52494): @potiuk
- fix: enable iframe script execution (#52257) (#52568): @kevinhongzl @pierrejeambrun
- [v3-0-test] Revert "Run release tests always - not only in canary runs (#52389)" (#52594) (#52595): @potiuk
- [v3-0-test] Increase dependency epoch to trigger pip cache invalidation (#52599) (#52601): @potiuk
- [v3-0-test] Fix SBOM commands to work for Airfow 2 (#52591) (#52604): @potiuk
- [v3-0-test] Add more dependency reports (#52606) (#52613): @potiuk
- [v3-0-test] Allow more empty loops before stopping log streaming (#52614) (#52624): @jedcunningham
Linked issues: - [v3-0-test] Upgrade uv to 0.7.17 (#52615) (#52625): @potiuk
- [v3-0-test] Improve dependency report and uppgrading (#52619) (#52626): @potiuk
- [v3-0-test] Bump pyarrow to 16.1.0 minimum version for several providers (#52635) (#52639): @potiuk
- [v3-0-test] Fix typoed parameter passign in calling a method in dev report (#52659) (#52661): @potiuk
- [v3-0-test] fix indent issue (#51701) (#52681): @nailo2c
- Backport Docs setup for the Task SDK (#51153) (#52682): @kaxil @sunank200
Linked issues: - [v3-0-test] Fix connection retrieval in triggerer for schema field, use by_alias=True for ConnectionResult (#52673) (#52691): @gopidesupavan
- [v3-0-test] Add http-only warning in documentation (#52631) (#52699): @alkismavridis
- [v3-0-test] Correctly treat requeues on reschedule sensors as resetting after each reschedule (#52706): @vatsrahul1001 @collinmcnulty
- [v3-0-test] docs(task-sdk): add and link dynamic task mapping docs (#51871) (#52707): @sunank200
- [v3-0-test] chore(tests): move doc tests to task-sdk/tests/docs (#51876) (#52708): @sunank200
- [v3-0-test] docs: streamline TaskFlow examples, link to core tutorial (#51827) (#52709): @sunank200
- [v3-0-test] Doc: Update version_added field for
socket_cleanup_timeout(#52705) (#52710): @kaxil - Add infinite scroll on tag search (#50732) (#52714): @aritra24 @pierrejeambrun
- [v3-0-test] Move costraint check to breeze (#52696) (#52715): @potiuk
- [v3-0-test] Cherry pick Grid view optimization (#51805) (#52718): @dstandish
- [v3-0-test] Ensure trigger kwargs are properly deserialized during trigger execution (#52693) (#52721): @amoghrajesh
Thanks to all who contributed to the release (probably not a complete list!):
@simi @collinmcnulty @amoghrajesh @kacpermuda @aritra24 @kyungjunleeme @ashb @dstandish @shubhamraj-git @uranusjr @jscheffl @jedcunningham @humit0 @SCH227 @ephraimbuddy @karenbraganz @nailo2c @r-richmond @alkismavridis @guan404ming @xBis7 @tirkarthi @sunank200 @gopidesupavan @dheerajturaga @Lee-W @kevinhongzl @jharriman @choo121600 @adilkhash @kaxil @potiuk @vincbeck @vatsrahul1001 @pierrejeambrun
Activity
potiuk commentedon Jul 2, 2025
impressive list !
karenbraganz commentedon Jul 3, 2025
@kaxil I checked out 3.0.3c1 and confirmed that my PR Add ti information to requeue logs #49995 is working on it. I deliberately got tasks stuck in queued and confirmed that the correct logs got printed. Is that what is needed for this issue?
aaron-y-chen commentedon Jul 3, 2025
I've tested it on my local setup, it looks great.
simi commentedon Jul 3, 2025
My change is only docs related and looks ok.
choo121600 commentedon Jul 3, 2025
I’ve tested the following changes and confirmed they are working as expected in 3.0.3rc1:
kaxil commentedon Jul 3, 2025
Yup
adilkhash commentedon Jul 3, 2025
works good to me! thanks!
[-]Status of testing of Apache Airflow 3.0.3rc1[/-][+]Status of testing of Apache Airflow 3.0.3rc2[/+]kaxil commentedon Jul 3, 2025
rc2 has been released with the following changes:
kacpermuda commentedon Jul 4, 2025
My change is ok.
kaxil commentedon Jul 4, 2025
rc3 has been released with the following changes:
start_from_triggeris True (#52861) #52873Lee-W commentedon Jul 5, 2025
Tested and confirmed
#51609 is for fixing CI and CI works fine.
potiuk commentedon Jul 5, 2025
Checked all my changes - all is good. This is really great that we have staging docs now - because I can immediately check if documentation changes are working.
As discussed on the devlist:
Issue with refreshing the UI after triggering DagRun (not sure if regression or not) The grid does not refresh with the new dag run when triggered in UI #52907
Fix to reproducibility: Exclude "openapi.merged.json" from built .sdist and .whl distributions #52908
jscheffl commentedon Jul 5, 2025
PR #52919 merged the bugfix to v3-0-test to fix the issue of UI refreshing that Jarek mentioned ^^^- if we decide to run a RC4 this would be the fix.
gopidesupavan commentedon Jul 6, 2025
Tested few examples dags, LGTM.
There is one default example dag broken with import errors, i have added fix here, #52956
humit0 commentedon Jul 7, 2025
Works fine in 3.0.3rc2.
kaxil commentedon Jul 9, 2025
3.0.3rc5 is out.
Changes since rc4:
log_urlon RuntimeTaskInstance in task sdk #50376get_allwhen we callXCom.get_all(#53020) #53102amoghrajesh commentedon Jul 10, 2025
Tested my changes:
Non functional changes / test only changes:
lenin GetXComCount processing toxcom_count(#51611) #51612Docs changes
CI fixes / release management fixes
Functional changes:
xcom_pullto cover different scenarios for mapped tasks #51568: tested with a comprehensive test dag and dag reported by author of the issue, all good!run_as_user) support for task execution #51780: created a custom user and tested few tasks with user impersonation (airflowuser), works as expectedrun_as_userto avoid "double" logging/plain-text-over-stdout #51934: no double logging anymoreProblems that lead to RCs:
get_allwhen we callXCom.get_all(#53020) #53102: tested with the dag the issue was reported with, works fine tookaxil commentedon Jul 11, 2025
rc6 is out.
Changes since rc5:
kaxil commentedon Jul 14, 2025
📣 We’ve just released Apache Airflow 3.0.3.
📦 PyPI: https://pypi.org/project/apache-airflow/3.0.3/
📚 Docs: https://airflow.apache.org/docs/apache-airflow/3.0.3/
🛠️ Release Notes: https://airflow.apache.org/docs/apache-airflow/3.0.3/release_notes.html
🪶 Sources: https://airflow.apache.org/docs/apache-airflow/3.0.3/installation/installing-from-sources.html
🐳 Docker Image: "docker pull apache/airflow:3.0.3"
🚏 Constraints: https://github.com/apache/airflow/tree/constraints-3.0.3