[MINOR][INFRA] List pip installation before test in python macos test…

… and python connect test ### What changes were proposed in this pull request? List pip installation before test in python macos test and python connect test ### Why are the changes needed? to improve the debugability, no need to check the installation log ### Does this PR introduce _any_ user-facing change? no ### How was this patch tested? ci ### Was this patch authored or co-authored using generative AI tooling? no Closes apache#49901 from zhengruifeng/infra_list_pip. Authored-by: Ruifeng Zheng <[email protected]> Signed-off-by: Ruifeng Zheng <[email protected]>
beliefer · Feb 12, 2025 · d6fe024 · d6fe024
1 parent 00f1057
commit d6fe024
Show file tree

Hide file tree

Showing 3 changed files with 8 additions and 3 deletions.
diff --git a/.github/workflows/build_python_connect.yml b/.github/workflows/build_python_connect.yml
@@ -72,7 +72,9 @@ jobs:
           python packaging/connect/setup.py sdist
           cd dist
           pip install pyspark*connect-*.tar.gz
-          pip install 'six==1.16.0' 'pandas==2.2.3' scipy 'plotly<6.0.0' 'mlflow>=2.8.1' coverage matplotlib openpyxl 'memory-profiler>=0.61.0' 'scikit-learn>=1.3.2' 'graphviz==0.20.3' 'torch<2.6.0' torchvision torcheval deepspeed unittest-xml-reporting 'plotly>=4.8'
+          pip install 'six==1.16.0' 'pandas==2.2.3' scipy 'plotly<6.0.0' 'mlflow>=2.8.1' coverage matplotlib openpyxl 'memory-profiler>=0.61.0' 'scikit-learn>=1.3.2' 'graphviz==0.20.3' 'torch<2.6.0' torchvision torcheval deepspeed unittest-xml-reporting
+      - name: List Python packages
+        run: python -m pip list
       - name: Run tests (local)
         env:
           SPARK_TESTING: 1

diff --git a/.github/workflows/build_python_connect35.yml b/.github/workflows/build_python_connect35.yml
@@ -75,6 +75,8 @@ jobs:
 
           # Add torch as a testing dependency for TorchDistributor
           pip install 'torch==2.0.1' 'torchvision==0.15.2' torcheval
+      - name: List Python packages
+        run: python -m pip list
       - name: Run tests
         env:
           SPARK_TESTING: 1

diff --git a/.github/workflows/python_macos_test.yml b/.github/workflows/python_macos_test.yml
@@ -135,8 +135,9 @@ jobs:
           python${{matrix.python}} -m pip install --ignore-installed 'six==1.16.0'
           python${{matrix.python}} -m pip install numpy 'pyarrow>=15.0.0' 'six==1.16.0' 'pandas==2.2.3' scipy 'plotly<6.0.0' 'mlflow>=2.8.1' coverage matplotlib openpyxl 'memory-profiler>=0.61.0' 'scikit-learn>=1.3.2' unittest-xml-reporting && \
           python${{matrix.python}} -m pip install 'grpcio==1.67.0' 'grpcio-status==1.67.0' 'protobuf==5.29.1' 'googleapis-common-protos==1.65.0' 'graphviz==0.20.3' && \
-          python${{matrix.python}} -m pip cache purge && \
-          python${{matrix.python}} -m pip list
+          python${{matrix.python}} -m pip cache purge
+      - name: List Python packages
+        run: python${{matrix.python}} -m pip list
       # Run the tests.
       - name: Run tests
         env: ${{ fromJSON(inputs.envs) }}