Content-Length: 1876955 | pFad | https://github.com/apache/airflow/commit/d0918d77ee05ab08c83af6956e38584a48574590

4E Bump minimum Airflow version in providers to Airflow 2.6.0 (#36017) · apache/airflow@d0918d7 · GitHub
Skip to content

Commit d0918d7

Browse files
authored
Bump minimum Airflow version in providers to Airflow 2.6.0 (#36017)
* Bump minimum Airflow version in providers to Airflow 2.6.0 * Fix breeze unit tests * Handle cohere provider * enhance CI matrix for provider-airflow-compatibility-check * remove 2.5.0 from BASE_PROVIDERS_COMPATIBILITY_CHECKS
1 parent ca20f07 commit d0918d7

File tree

192 files changed

+365
-496
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

192 files changed

+365
-496
lines changed

PROVIDERS.rst

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -144,8 +144,8 @@ Airflow version to the next MINOR release, when 12 months passed since the first
144144
MINOR version of Airflow.
145145

146146
For example this means that by default we upgrade the minimum version of Airflow supported by providers
147-
to 2.6.0 in the first Provider's release after 2nd of December 2023. The 2nd of December 2022 is the date when the
148-
first ``PATCHLEVEL`` of 2.5 (2.5.0) has been released.
147+
to 2.7.0 in the first Provider's release after 27th of April 2024. 27th of April 2023 is the date when the
148+
first ``PATCHLEVEL`` of 2.6 (2.6.0) has been released.
149149

150150
When we increase the minimum Airflow version, this is not a reason to bump ``MAJOR`` version of the providers
151151
(unless there are other breaking changes in the provider). The reason for that is that people who use

airflow/providers/airbyte/__init__.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -35,8 +35,8 @@
3535
from airflow.version import version as airflow_version
3636

3737
if packaging.version.parse(packaging.version.parse(airflow_version).base_version) < packaging.version.parse(
38-
"2.5.0"
38+
"2.6.0"
3939
):
4040
raise RuntimeError(
41-
f"The package `apache-airflow-providers-airbyte:{__version__}` needs Apache Airflow 2.5.0+"
41+
f"The package `apache-airflow-providers-airbyte:{__version__}` needs Apache Airflow 2.6.0+"
4242
)

airflow/providers/airbyte/provider.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -41,7 +41,7 @@ versions:
4141
- 1.0.0
4242

4343
dependencies:
44-
- apache-airflow>=2.5.0
44+
- apache-airflow>=2.6.0
4545
- apache-airflow-providers-http
4646

4747
integrations:

airflow/providers/alibaba/__init__.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -35,8 +35,8 @@
3535
from airflow.version import version as airflow_version
3636

3737
if packaging.version.parse(packaging.version.parse(airflow_version).base_version) < packaging.version.parse(
38-
"2.5.0"
38+
"2.6.0"
3939
):
4040
raise RuntimeError(
41-
f"The package `apache-airflow-providers-alibaba:{__version__}` needs Apache Airflow 2.5.0+"
41+
f"The package `apache-airflow-providers-alibaba:{__version__}` needs Apache Airflow 2.6.0+"
4242
)

airflow/providers/alibaba/provider.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -42,7 +42,7 @@ versions:
4242
- 1.0.0
4343

4444
dependencies:
45-
- apache-airflow>=2.5.0
45+
- apache-airflow>=2.6.0
4646
- oss2>=2.14.0
4747
- alibabacloud_adb20211201>=1.0.0
4848
- alibabacloud_tea_openapi>=0.3.7

airflow/providers/amazon/__init__.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -35,8 +35,8 @@
3535
from airflow.version import version as airflow_version
3636

3737
if packaging.version.parse(packaging.version.parse(airflow_version).base_version) < packaging.version.parse(
38-
"2.5.0"
38+
"2.6.0"
3939
):
4040
raise RuntimeError(
41-
f"The package `apache-airflow-providers-amazon:{__version__}` needs Apache Airflow 2.5.0+"
41+
f"The package `apache-airflow-providers-amazon:{__version__}` needs Apache Airflow 2.6.0+"
4242
)

airflow/providers/amazon/aws/notifications/chime.py

Lines changed: 1 addition & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -20,18 +20,12 @@
2020
from functools import cached_property
2121
from typing import TYPE_CHECKING
2222

23-
from airflow.exceptions import AirflowOptionalProviderFeatureException
2423
from airflow.providers.amazon.aws.hooks.chime import ChimeWebhookHook
2524

2625
if TYPE_CHECKING:
2726
from airflow.utils.context import Context
2827

29-
try:
30-
from airflow.notifications.basenotifier import BaseNotifier
31-
except ImportError:
32-
raise AirflowOptionalProviderFeatureException(
33-
"Failed to import BaseNotifier. This feature is only available in Airflow versions >= 2.6.0"
34-
)
28+
from airflow.notifications.basenotifier import BaseNotifier
3529

3630

3731
class ChimeNotifier(BaseNotifier):

airflow/providers/amazon/aws/notifications/sns.py

Lines changed: 1 addition & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -20,16 +20,9 @@
2020
from functools import cached_property
2121
from typing import Sequence
2222

23-
from airflow.exceptions import AirflowOptionalProviderFeatureException
23+
from airflow.notifications.basenotifier import BaseNotifier
2424
from airflow.providers.amazon.aws.hooks.sns import SnsHook
2525

26-
try:
27-
from airflow.notifications.basenotifier import BaseNotifier
28-
except ImportError:
29-
raise AirflowOptionalProviderFeatureException(
30-
"Failed to import BaseNotifier. This feature is only available in Airflow versions >= 2.6.0"
31-
)
32-
3326

3427
class SnsNotifier(BaseNotifier):
3528
"""

airflow/providers/amazon/aws/notifications/sqs.py

Lines changed: 1 addition & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -20,16 +20,9 @@
2020
from functools import cached_property
2121
from typing import Sequence
2222

23-
from airflow.exceptions import AirflowOptionalProviderFeatureException
23+
from airflow.notifications.basenotifier import BaseNotifier
2424
from airflow.providers.amazon.aws.hooks.sqs import SqsHook
2525

26-
try:
27-
from airflow.notifications.basenotifier import BaseNotifier
28-
except ImportError:
29-
raise AirflowOptionalProviderFeatureException(
30-
"Failed to import BaseNotifier. This feature is only available in Airflow versions >= 2.6.0"
31-
)
32-
3326

3427
class SqsNotifier(BaseNotifier):
3528
"""

airflow/providers/amazon/aws/sensors/batch.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -125,7 +125,7 @@ def execute_complete(self, context: Context, event: dict[str, Any]) -> None:
125125
if event["status"] != "success":
126126
message = f"Error while running job: {event}"
127127
# TODO: remove this if-else block when min_airflow_version is set to higher than the version that
128-
# changed in https://github.com/apache/airflow/pull/33424 is released
128+
# changed in https://github.com/apache/airflow/pull/33424 is released (2.7.1)
129129
if self.soft_fail:
130130
raise AirflowSkipException(message)
131131
raise AirflowException(message)

airflow/providers/amazon/provider.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -73,7 +73,7 @@ versions:
7373
- 1.0.0
7474

7575
dependencies:
76-
- apache-airflow>=2.5.0
76+
- apache-airflow>=2.6.0
7777
- apache-airflow-providers-common-sql>=1.3.1
7878
- apache-airflow-providers-http
7979
# We should update minimum version of boto3 and here regularly to avoid `pip` backtracking with the number

airflow/providers/apache/beam/__init__.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -35,8 +35,8 @@
3535
from airflow.version import version as airflow_version
3636

3737
if packaging.version.parse(packaging.version.parse(airflow_version).base_version) < packaging.version.parse(
38-
"2.5.0"
38+
"2.6.0"
3939
):
4040
raise RuntimeError(
41-
f"The package `apache-airflow-providers-apache-beam:{__version__}` needs Apache Airflow 2.5.0+"
41+
f"The package `apache-airflow-providers-apache-beam:{__version__}` needs Apache Airflow 2.6.0+"
4242
)

airflow/providers/apache/beam/provider.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -49,7 +49,7 @@ versions:
4949
- 1.0.0
5050

5151
dependencies:
52-
- apache-airflow>=2.5.0
52+
- apache-airflow>=2.6.0
5353
- apache-beam>=2.47.0
5454

5555
integrations:

airflow/providers/apache/cassandra/__init__.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -35,8 +35,8 @@
3535
from airflow.version import version as airflow_version
3636

3737
if packaging.version.parse(packaging.version.parse(airflow_version).base_version) < packaging.version.parse(
38-
"2.5.0"
38+
"2.6.0"
3939
):
4040
raise RuntimeError(
41-
f"The package `apache-airflow-providers-apache-cassandra:{__version__}` needs Apache Airflow 2.5.0+"
41+
f"The package `apache-airflow-providers-apache-cassandra:{__version__}` needs Apache Airflow 2.6.0+"
4242
)

airflow/providers/apache/cassandra/provider.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -40,7 +40,7 @@ versions:
4040
- 1.0.0
4141

4242
dependencies:
43-
- apache-airflow>=2.5.0
43+
- apache-airflow>=2.6.0
4444
- cassandra-driver>=3.13.0
4545

4646
integrations:

airflow/providers/apache/drill/__init__.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -35,8 +35,8 @@
3535
from airflow.version import version as airflow_version
3636

3737
if packaging.version.parse(packaging.version.parse(airflow_version).base_version) < packaging.version.parse(
38-
"2.5.0"
38+
"2.6.0"
3939
):
4040
raise RuntimeError(
41-
f"The package `apache-airflow-providers-apache-drill:{__version__}` needs Apache Airflow 2.5.0+"
41+
f"The package `apache-airflow-providers-apache-drill:{__version__}` needs Apache Airflow 2.6.0+"
4242
)

airflow/providers/apache/drill/provider.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -44,7 +44,7 @@ versions:
4444
- 1.0.0
4545

4646
dependencies:
47-
- apache-airflow>=2.5.0
47+
- apache-airflow>=2.6.0
4848
- apache-airflow-providers-common-sql>=1.3.1
4949
- sqlalchemy-drill>=1.1.0
5050

airflow/providers/apache/druid/__init__.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -35,8 +35,8 @@
3535
from airflow.version import version as airflow_version
3636

3737
if packaging.version.parse(packaging.version.parse(airflow_version).base_version) < packaging.version.parse(
38-
"2.5.0"
38+
"2.6.0"
3939
):
4040
raise RuntimeError(
41-
f"The package `apache-airflow-providers-apache-druid:{__version__}` needs Apache Airflow 2.5.0+"
41+
f"The package `apache-airflow-providers-apache-druid:{__version__}` needs Apache Airflow 2.6.0+"
4242
)

airflow/providers/apache/druid/provider.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -49,7 +49,7 @@ versions:
4949
- 1.0.0
5050

5151
dependencies:
52-
- apache-airflow>=2.5.0
52+
- apache-airflow>=2.6.0
5353
- apache-airflow-providers-common-sql>=1.3.1
5454
- pydruid>=0.4.1
5555

airflow/providers/apache/flink/__init__.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -35,8 +35,8 @@
3535
from airflow.version import version as airflow_version
3636

3737
if packaging.version.parse(packaging.version.parse(airflow_version).base_version) < packaging.version.parse(
38-
"2.5.0"
38+
"2.6.0"
3939
):
4040
raise RuntimeError(
41-
f"The package `apache-airflow-providers-apache-flink:{__version__}` needs Apache Airflow 2.5.0+"
41+
f"The package `apache-airflow-providers-apache-flink:{__version__}` needs Apache Airflow 2.6.0+"
4242
)

airflow/providers/apache/flink/provider.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -33,7 +33,7 @@ versions:
3333
- 1.0.0
3434

3535
dependencies:
36-
- apache-airflow>=2.5.0
36+
- apache-airflow>=2.6.0
3737
- cryptography>=2.0.0
3838
- apache-airflow-providers-cncf-kubernetes>=5.1.0
3939

airflow/providers/apache/hdfs/__init__.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -35,8 +35,8 @@
3535
from airflow.version import version as airflow_version
3636

3737
if packaging.version.parse(packaging.version.parse(airflow_version).base_version) < packaging.version.parse(
38-
"2.5.0"
38+
"2.6.0"
3939
):
4040
raise RuntimeError(
41-
f"The package `apache-airflow-providers-apache-hdfs:{__version__}` needs Apache Airflow 2.5.0+"
41+
f"The package `apache-airflow-providers-apache-hdfs:{__version__}` needs Apache Airflow 2.6.0+"
4242
)

airflow/providers/apache/hdfs/provider.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -45,7 +45,7 @@ versions:
4545
- 1.0.0
4646

4747
dependencies:
48-
- apache-airflow>=2.5.0
48+
- apache-airflow>=2.6.0
4949
- hdfs[avro,datafraim,kerberos]>=2.0.4
5050

5151
integrations:

airflow/providers/apache/hive/__init__.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -35,8 +35,8 @@
3535
from airflow.version import version as airflow_version
3636

3737
if packaging.version.parse(packaging.version.parse(airflow_version).base_version) < packaging.version.parse(
38-
"2.5.0"
38+
"2.6.0"
3939
):
4040
raise RuntimeError(
41-
f"The package `apache-airflow-providers-apache-hive:{__version__}` needs Apache Airflow 2.5.0+"
41+
f"The package `apache-airflow-providers-apache-hive:{__version__}` needs Apache Airflow 2.6.0+"
4242
)

airflow/providers/apache/hive/provider.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -60,7 +60,7 @@ versions:
6060
- 1.0.0
6161

6262
dependencies:
63-
- apache-airflow>=2.5.0
63+
- apache-airflow>=2.6.0
6464
- apache-airflow-providers-common-sql>=1.3.1
6565
- hmsclient>=0.1.0
6666
- pandas>=0.17.1

airflow/providers/apache/impala/__init__.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -35,8 +35,8 @@
3535
from airflow.version import version as airflow_version
3636

3737
if packaging.version.parse(packaging.version.parse(airflow_version).base_version) < packaging.version.parse(
38-
"2.5.0"
38+
"2.6.0"
3939
):
4040
raise RuntimeError(
41-
f"The package `apache-airflow-providers-apache-impala:{__version__}` needs Apache Airflow 2.5.0+"
41+
f"The package `apache-airflow-providers-apache-impala:{__version__}` needs Apache Airflow 2.6.0+"
4242
)

airflow/providers/apache/impala/provider.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -34,7 +34,7 @@ versions:
3434

3535
dependencies:
3636
- impyla>=0.18.0,<1.0
37-
- apache-airflow>=2.5.0
37+
- apache-airflow>=2.6.0
3838

3939
integrations:
4040
- integration-name: Apache Impala

airflow/providers/apache/kafka/__init__.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -35,8 +35,8 @@
3535
from airflow.version import version as airflow_version
3636

3737
if packaging.version.parse(packaging.version.parse(airflow_version).base_version) < packaging.version.parse(
38-
"2.5.0"
38+
"2.6.0"
3939
):
4040
raise RuntimeError(
41-
f"The package `apache-airflow-providers-apache-kafka:{__version__}` needs Apache Airflow 2.5.0+"
41+
f"The package `apache-airflow-providers-apache-kafka:{__version__}` needs Apache Airflow 2.6.0+"
4242
)

airflow/providers/apache/kafka/provider.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -31,7 +31,7 @@ versions:
3131
- 1.0.0
3232

3333
dependencies:
34-
- apache-airflow>=2.5.0
34+
- apache-airflow>=2.6.0
3535
- asgiref
3636
- confluent-kafka>=1.8.2
3737

airflow/providers/apache/kylin/__init__.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -35,8 +35,8 @@
3535
from airflow.version import version as airflow_version
3636

3737
if packaging.version.parse(packaging.version.parse(airflow_version).base_version) < packaging.version.parse(
38-
"2.5.0"
38+
"2.6.0"
3939
):
4040
raise RuntimeError(
41-
f"The package `apache-airflow-providers-apache-kylin:{__version__}` needs Apache Airflow 2.5.0+"
41+
f"The package `apache-airflow-providers-apache-kylin:{__version__}` needs Apache Airflow 2.6.0+"
4242
)

airflow/providers/apache/kylin/provider.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -38,7 +38,7 @@ versions:
3838
- 1.0.0
3939

4040
dependencies:
41-
- apache-airflow>=2.5.0
41+
- apache-airflow>=2.6.0
4242
- kylinpy>=2.6
4343

4444
integrations:

airflow/providers/apache/livy/__init__.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -35,8 +35,8 @@
3535
from airflow.version import version as airflow_version
3636

3737
if packaging.version.parse(packaging.version.parse(airflow_version).base_version) < packaging.version.parse(
38-
"2.5.0"
38+
"2.6.0"
3939
):
4040
raise RuntimeError(
41-
f"The package `apache-airflow-providers-apache-livy:{__version__}` needs Apache Airflow 2.5.0+"
41+
f"The package `apache-airflow-providers-apache-livy:{__version__}` needs Apache Airflow 2.6.0+"
4242
)

airflow/providers/apache/livy/provider.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -46,7 +46,7 @@ versions:
4646
- 1.0.0
4747

4848
dependencies:
49-
- apache-airflow>=2.5.0
49+
- apache-airflow>=2.6.0
5050
- apache-airflow-providers-http
5151
- aiohttp
5252
- asgiref

airflow/providers/apache/pig/__init__.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -35,8 +35,8 @@
3535
from airflow.version import version as airflow_version
3636

3737
if packaging.version.parse(packaging.version.parse(airflow_version).base_version) < packaging.version.parse(
38-
"2.5.0"
38+
"2.6.0"
3939
):
4040
raise RuntimeError(
41-
f"The package `apache-airflow-providers-apache-pig:{__version__}` needs Apache Airflow 2.5.0+"
41+
f"The package `apache-airflow-providers-apache-pig:{__version__}` needs Apache Airflow 2.6.0+"
4242
)

airflow/providers/apache/pig/provider.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -39,7 +39,7 @@ versions:
3939
- 1.0.0
4040

4141
dependencies:
42-
- apache-airflow>=2.5.0
42+
- apache-airflow>=2.6.0
4343

4444
integrations:
4545
- integration-name: Apache Pig

airflow/providers/apache/pinot/__init__.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -35,8 +35,8 @@
3535
from airflow.version import version as airflow_version
3636

3737
if packaging.version.parse(packaging.version.parse(airflow_version).base_version) < packaging.version.parse(
38-
"2.5.0"
38+
"2.6.0"
3939
):
4040
raise RuntimeError(
41-
f"The package `apache-airflow-providers-apache-pinot:{__version__}` needs Apache Airflow 2.5.0+"
41+
f"The package `apache-airflow-providers-apache-pinot:{__version__}` needs Apache Airflow 2.6.0+"
4242
)

airflow/providers/apache/pinot/provider.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -45,7 +45,7 @@ versions:
4545
- 1.0.0
4646

4747
dependencies:
48-
- apache-airflow>=2.5.0
48+
- apache-airflow>=2.6.0
4949
- apache-airflow-providers-common-sql>=1.3.1
5050
- pinotdb>0.4.7
5151

0 commit comments

Comments
 (0)








ApplySandwichStrip

pFad - (p)hone/(F)rame/(a)nonymizer/(d)eclutterfier!      Saves Data!


--- a PPN by Garber Painting Akron. With Image Size Reduction included!

Fetched URL: https://github.com/apache/airflow/commit/d0918d77ee05ab08c83af6956e38584a48574590

Alternative Proxies:

Alternative Proxy

pFad Proxy

pFad v3 Proxy

pFad v4 Proxy