Repository navigation
Add proper dependencies for sqlalchemy - dependent providers #59895
Description
Some of our providers have direct imports from sqlalchemy:
The sqlalchemy dependency there is usualy for very small part of the functionality of those providers, so it should be "Optional Provider Feature" rather than being effectively "mandatory" dependency. This is not a problem today - but when we have task isolation in place, task-sdk will have no sqlalchemy as dependency, so those providers should have optional sqlalchemy extra + handling importing the hooks when sqlalchemy is not installed (i.e. either raising OptionalProviderFeatureException when used, and handling fallback to import errors when sqlalchemy import fails.
The way how it should be done:
-
for those providers that "need" sqlalchemy badly - sqlalchemy (same specification as in airflow-core now) should be added as "required" dependency
-
for those providers where sqlalchemy is just for some feature, we should make sure that they handle lack of sqlalchemy installed - handing import error, and raising "Optional Provider Feature" exception when a method that needs sqlalchemy is callsed and sqlalchemy is not installed. Sqlalchemy should be added as "extra"
sqlalchemydependency.
Activity
2 remaining items
mohit7705 commentedon Dec 29, 2025
Hi @potiuk 👋
I’d like to work on Add proper dependencies for sqlalchemy – postgres (#59905) if it’s still available.
I’m new to Airflow contributions but familiar with Python dependency management and optional imports.
Please let me know if I can proceed. Thanks!
potiuk commentedon Dec 29, 2025
Please comment in specific issue and I will assign you. I cannot assign you if you do not comment on the issue to be assigned to.
sunank200 commentedon Dec 30, 2025
@potiuk I can work on Amazon, Impala, Open Lineage and Edge3.
sunank200 commentedon Dec 30, 2025
Seems like they are already assigned. If those are not picked up, I can take it up.
potiuk commentedon Dec 30, 2025
I think all of the sub-issues are assigned already - unless of course someone wants to give it to @sunank200 :).
potiuk commentedon Jan 4, 2026
@sunank200 -> databricks one is u for grabs now.
eladkal commentedon Mar 29, 2026
I think all tasks in this issue are resolved?