diff --git a/CONTRIBUTING.rst b/CONTRIBUTING.rst index 95dd13e6b2bfd..ee673279c813f 100644 --- a/CONTRIBUTING.rst +++ b/CONTRIBUTING.rst @@ -1,4 +1,4 @@ - .. Licensed to the Apache Software Foundation (ASF) under one +.. Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements. See the NOTICE file distributed with this work for additional information regarding copyright ownership. The ASF licenses this file @@ -532,6 +532,15 @@ than production performance. The production images are not yet officially publis Airflow dependencies ==================== +.. note:: + + On November 2020, new version of PIP (20.3) has been released with a new, 2020 resolver. This resolver + does not yet work with Apache Airflow and might leads to errors in installation - depends on your choice + of extras. In order to install Airflow you need to either downgrade pip to version 20.2.4 + ``pip upgrade --pip==20.2.4`` or, in case you use Pip 20.3, you need to add option + ``--use-deprecated legacy-resolver`` to your pip install command. + + Extras ------ @@ -666,6 +675,15 @@ as of airflow 1.10.10 and further improved with 1.10.12 (moved to separate orpha Pinned constraint files ======================= +.. note:: + + On November 2020, new version of PIP (20.3) has been released with a new, 2020 resolver. This resolver + does not yet work with Apache Airflow and might leads to errors in installation - depends on your choice + of extras. In order to install Airflow you need to either downgrade pip to version 20.2.4 + ``pip upgrade --pip==20.2.4`` or, in case you use Pip 20.3, you need to add option + ``--use-deprecated legacy-resolver`` to your pip install command. + + By default when you install ``apache-airflow`` package - the dependencies are as open as possible while still allowing the apache-airflow package to install. This means that ``apache-airflow`` package might fail to install in case a direct or transitive dependency is released that breaks the installation. In such case diff --git a/IMAGES.rst b/IMAGES.rst index 6672536c28424..9f9a6423a2dbe 100644 --- a/IMAGES.rst +++ b/IMAGES.rst @@ -117,6 +117,16 @@ parameter to Breeze: ./breeze build-image --python 3.7 --additional-extras=presto \ --production-image --install-airflow-version=1.10.13 + +.. note:: + + On November 2020, new version of PIP (20.3) has been released with a new, 2020 resolver. This resolver + does not yet work with Apache Airflow and might leads to errors in installation - depends on your choice + of extras. In order to install Airflow you need to either downgrade pip to version 20.2.4 + ``pip upgrade --pip==20.2.4`` or, in case you use Pip 20.3, you need to add option + ``--use-deprecated legacy-resolver`` to your pip install command. + + This will build the image using command similar to: .. code-block:: bash diff --git a/INSTALL b/INSTALL index bf44ada8dda2a..f02d685ecd251 100644 --- a/INSTALL +++ b/INSTALL @@ -28,6 +28,14 @@ java -jar apache-rat.jar -E ./.rat-excludes -d . python3 -m venv PATH_TO_YOUR_VENV source PATH_TO_YOUR_VENV/bin/activate +NOTE!! + +On November 2020, new version of PIP (20.3) has been released with a new, 2020 resolver. This resolver +does not yet work with Apache Airflow and might leads to errors in installation - depends on your choice +of extras. In order to install Airflow you need to either downgrade pip to version 20.2.4 +``pip upgrade --pip==20.2.4`` or, in case you use Pip 20.3, you need to add option +``--use-deprecated legacy-resolver`` to your pip install command. + # [required] building and installing by pip (preferred) pip install . diff --git a/LOCAL_VIRTUALENV.rst b/LOCAL_VIRTUALENV.rst index 35a7408d6c7d7..15eeadf41b355 100644 --- a/LOCAL_VIRTUALENV.rst +++ b/LOCAL_VIRTUALENV.rst @@ -61,6 +61,16 @@ of required packages. Extra Packages -------------- +.. note:: + + On November 2020, new version of PIP (20.3) has been released with a new, 2020 resolver. This resolver + does not yet work with Apache Airflow and might leads to errors in installation - depends on your choice + of extras. In order to install Airflow you need to either downgrade pip to version 20.2.4 + ``pip upgrade --pip==20.2.4`` or, in case you use Pip 20.3, you need to add option + ``--use-deprecated legacy-resolver`` to your pip install command. + + + You can also install extra packages (like ``[ssh]``, etc) via ``pip install -e [EXTRA1,EXTRA2 ...]``. However, some of them may have additional install and setup requirements for your local system. @@ -114,6 +124,15 @@ To create and initialize the local virtualenv: 2. Install Python PIP requirements: +.. note:: + + On November 2020, new version of PIP (20.3) has been released with a new, 2020 resolver. This resolver + does not yet work with Apache Airflow and might leads to errors in installation - depends on your choice + of extras. In order to install Airflow you need to either downgrade pip to version 20.2.4 + ``pip upgrade --pip==20.2.4`` or, in case you use Pip 20.3, you need to add option + ``--use-deprecated legacy-resolver`` to your pip install command. + + .. code-block:: bash pip install -U -e ".[devel,]" # for example: pip install -U -e ".[devel,google,postgres]" diff --git a/README.md b/README.md index bdda07042a154..47dbe3b701622 100644 --- a/README.md +++ b/README.md @@ -122,6 +122,15 @@ correct Airflow tag/version/branch and python versions in the URL. 1. Installing just Airflow: +NOTE!!! + +On November 2020, new version of PIP (20.3) has been released with a new, 2020 resolver. This resolver +does not yet work with Apache Airflow and might leads to errors in installation - depends on your choice +of extras. In order to install Airflow you need to either downgrade pip to version 20.2.4 +`pip upgrade --pip==20.2.4` or, in case you use Pip 20.3, you need to add option +`--use-deprecated legacy-resolver` to your pip install command. + + ```bash pip install apache-airflow==1.10.13 \ --constraint "https://raw.githubusercontent.com/apache/airflow/constraints-1.10.13/constraints-3.7.txt" diff --git a/UPDATING.md b/UPDATING.md index 6af5e09be8b8b..7ef41b37445ae 100644 --- a/UPDATING.md +++ b/UPDATING.md @@ -1668,6 +1668,16 @@ For example: If you want to install integration for Microsoft Azure, then instead of `pip install apache-airflow[atlas]` you should use `pip install apache-airflow[apache.atlas]`. + +NOTE! + +On November 2020, new version of PIP (20.3) has been released with a new, 2020 resolver. This resolver +does not yet work with Apache Airflow and might leads to errors in installation - depends on your choice +of extras. In order to install Airflow you need to either downgrade pip to version 20.2.4 +`pip upgrade --pip==20.2.4` or, in case you use Pip 20.3, you need to add option +`--use-deprecated legacy-resolver` to your pip install command. + + If you want to install integration for Microsoft Azure, then instead of ``` diff --git a/UPGRADING_TO_2.0.md b/UPGRADING_TO_2.0.md index b21c81ee4ef74..7b2c069f2a93a 100644 --- a/UPGRADING_TO_2.0.md +++ b/UPGRADING_TO_2.0.md @@ -51,6 +51,15 @@ assists users migrating to a new version. +NOTE! + +On November 2020, new version of PIP (20.3) has been released with a new, 2020 resolver. This resolver +does not yet work with Apache Airflow and might leads to errors in installation - depends on your choice +of extras. In order to install Airflow you need to either downgrade pip to version 20.2.4 +`pip upgrade --pip==20.2.4` or, in case you use Pip 20.3, you need to add option +`--use-deprecated legacy-resolver` to your pip install command. + + ## Step 1: Upgrade to Python 3 Airflow 1.10 will be the last release series to support Python 2. Airflow 2.0.0 will require Python 3.6+. @@ -102,6 +111,15 @@ The most important step in this transition is also the easiest step to do in pie using the [backport providers](./backport-providers.rst) service. In your own time, you can transition to using these backport-providers by pip installing the provider via `pypi` and changing the import path. + +NOTE!! + +On November 2020, new version of PIP (20.3) has been released with a new, 2020 resolver. This resolver +does not yet work with Apache Airflow and might leads to errors in installation - depends on your choice +of extras. In order to install Airflow you need to either downgrade pip to version 20.2.4 +`pip upgrade --pip==20.2.4` or, in case you use Pip 20.3, you need to add option +`--use-deprecated legacy-resolver` to your pip install command. + For example: While historically you might have imported the DockerOperator in this fashion: ```python diff --git a/airflow/providers/discord/README.md b/airflow/providers/discord/README.md index 1701b6228fa76..c409d5f9af28d 100644 --- a/airflow/providers/discord/README.md +++ b/airflow/providers/discord/README.md @@ -47,6 +47,7 @@ are in `airflow.providers.discord` python package. ## Installation + You can install this package on top of an existing airflow 2.* installation via `pip install apache-airflow-providers-discord` diff --git a/dev/provider_packages/PROVIDER_README_TEMPLATE.md.jinja2 b/dev/provider_packages/PROVIDER_README_TEMPLATE.md.jinja2 index b85258506abb2..2a00cc49276d3 100644 --- a/dev/provider_packages/PROVIDER_README_TEMPLATE.md.jinja2 +++ b/dev/provider_packages/PROVIDER_README_TEMPLATE.md.jinja2 @@ -60,6 +60,14 @@ are in `{{FULL_PACKAGE_NAME}}` python package. ## Installation +NOTE! + +On November 2020, new version of PIP (20.3) has been released with a new, 2020 resolver. This resolver +does not yet work with Apache Airflow and might leads to errors in installation - depends on your choice +of extras. In order to install Airflow you need to either downgrade pip to version 20.2.4 +`pip upgrade --pip==20.2.4` or, in case you use Pip 20.3, you need to add option +`--use-deprecated legacy-resolver` to your pip install command. + You can install this package on top of an existing airflow 2.* installation via `pip install {{PACKAGE_PIP_NAME}}` diff --git a/docs/apache-airflow/installation.rst b/docs/apache-airflow/installation.rst index 2dccad6beb60a..ad878dd967e88 100644 --- a/docs/apache-airflow/installation.rst +++ b/docs/apache-airflow/installation.rst @@ -50,6 +50,15 @@ and python versions in the URL. 1. Installing just Airflow +.. note:: + + On November 2020, new version of PIP (20.3) has been released with a new, 2020 resolver. This resolver + does not yet work with Apache Airflow and might leads to errors in installation - depends on your choice + of extras. In order to install Airflow you need to either downgrade pip to version 20.2.4 + ``pip upgrade --pip==20.2.4`` or, in case you use Pip 20.3, you need to add option + ``--use-deprecated legacy-resolver`` to your pip install command. + + .. code-block:: bash AIRFLOW_VERSION=1.10.13 @@ -61,6 +70,15 @@ and python versions in the URL. 2. Installing with extras (for example postgres, google) +.. note:: + + On November 2020, new version of PIP (20.3) has been released with a new, 2020 resolver. This resolver + does not yet work with Apache Airflow and might leads to errors in installation - depends on your choice + of extras. In order to install Airflow you need to either downgrade pip to version 20.2.4 + ``pip upgrade --pip==20.2.4`` or, in case you use Pip 20.3, you need to add option + ``--use-deprecated legacy-resolver`` to your pip install command. + + .. code-block:: bash AIRFLOW_VERSION=1.10.13 @@ -74,11 +92,6 @@ Airflow with such extras, the necessary provider packages are installed automati PyPI for those packages). However you can freely upgrade and install provider packages independently from the main Airflow installation. -.. note:: Automated installation of Provider packages does not work in Airflow 2.0.0b1 - for this version - you have to install provider packages manually. As of Airflow 2.0.0b2 the corresponding - provider packages are installed together with the extras. - -Read more about it in the :ref:`Provider Packages ` section. Requirements '''''''''''' diff --git a/docs/apache-airflow/start.rst b/docs/apache-airflow/start.rst index fd76bb962c489..5807a330ea022 100644 --- a/docs/apache-airflow/start.rst +++ b/docs/apache-airflow/start.rst @@ -20,6 +20,15 @@ Quick Start ----------- +.. note:: + + On November 2020, new version of PIP (20.3) has been released with a new, 2020 resolver. This resolver + does not yet work with Apache Airflow and might leads to errors in installation - depends on your choice + of extras. In order to install Airflow you need to either downgrade pip to version 20.2.4 + ``pip upgrade --pip==20.2.4`` or, in case you use Pip 20.3, you need to add option + ``--use-deprecated legacy-resolver`` to your pip install command. + + The installation is quick and straightforward. .. code-block:: bash