Skip to content

Support azure-datalake-store 1.x in the Microsoft Azure provider #73795

Description

@potiuk

The Microsoft Azure provider caps azure-datalake-store<1. azure-datalake-store 1.0.1 removed the lib.auth API that AzureDataLakeHook.get_conn() calls (providers/microsoft/azure/src/airflow/providers/microsoft/azure/hooks/data_lake.py). With 1.x installed, creating the Data Lake Gen1 connection with a tenant/secret fails. Every TestAzureDataLakeHook test also fails with AttributeError: Mock object has no attribute 'auth', which is what kept the scheduled CI upgrade (#73629) red.

The cap was added in the CI upgrade PR to unblock it. Neither the CI upgrade (breeze ci upgrade) nor the automatic dependency floor bump will lift it on their own.

To do

  • Port AzureDataLakeHook.get_conn() to the credential API that azure-datalake-store 1.x provides.
  • Update the TestAzureDataLakeHook mocks to match.
  • Decide whether to keep 0.0.x working or raise the floor to >=1. A floor raise is a breaking change for the provider and needs a changelog entry.

Done when

  • The <1 cap and its comment are removed from providers/microsoft/azure/pyproject.toml.
  • The azure-datalake-store entry is removed from [tool.airflow.dependency-floors.exclude] in the root pyproject.toml.
  • The azure provider tests pass on 1.x, including LowestDeps.

Drafted-by: Claude Code (Opus 5); reviewed by @potiuk before posting

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions