Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

GH-38060: [Python][CI] Upgrade Spark versions #38082

Merged
merged 1 commit into from
Oct 6, 2023

Conversation

danepitkin
Copy link
Member

@danepitkin danepitkin commented Oct 6, 2023

Rationale for this change

Spark released 3.5.0 and dropped support for Java 8 and 11 on main.

What changes are included in this PR?

  • Upgrade Spark integration tests from v3.4.1 -> 3.5.0
  • Use JDK 17 for Spark latest

Are these changes tested?

Will test in CI

Are there any user-facing changes?

No

@danepitkin danepitkin marked this pull request as draft October 6, 2023 16:27
@danepitkin
Copy link
Member Author

@github-actions crossbow submit spark

@github-actions github-actions bot added the awaiting review Awaiting review label Oct 6, 2023
@github-actions
Copy link

github-actions bot commented Oct 6, 2023

Revision: 4f79949

Submitted crossbow builds: ursacomputing/crossbow @ actions-55ad3a7fe5

Task Status
test-conda-python-3.10-spark-v3.5.0 Github Actions
test-conda-python-3.11-spark-master Github Actions
test-conda-python-3.8-spark-v3.5.0 Github Actions

@danepitkin danepitkin changed the title Upgrade Spark versions GH-38060: [Python][CI] Upgrade Spark versions Oct 6, 2023
@github-actions
Copy link

github-actions bot commented Oct 6, 2023

⚠️ GitHub issue #38060 has been automatically assigned in GitHub to PR creator.

@danepitkin danepitkin marked this pull request as ready for review October 6, 2023 19:00
Copy link
Member

@kou kou left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1

@kou kou merged commit 3697bcd into apache:main Oct 6, 2023
@kou kou removed the awaiting review Awaiting review label Oct 6, 2023
@github-actions github-actions bot added the awaiting merge Awaiting merge label Oct 6, 2023
@danepitkin
Copy link
Member Author

Thanks @kou !

@conbench-apache-arrow
Copy link

After merging your PR, Conbench analyzed the 5 benchmarking runs that have been run so far on merge-commit 3697bcd.

There were no benchmark performance regressions. 🎉

The full Conbench report has more details. It also includes information about 8 possible false positives for unstable benchmarks that are known to sometimes produce them.

JerAguilon pushed a commit to JerAguilon/arrow that referenced this pull request Oct 23, 2023
### Rationale for this change

Spark released 3.5.0 and dropped support for Java 8 and 11 on main.

### What changes are included in this PR?

* Upgrade Spark integration tests from v3.4.1 -> 3.5.0
* Use JDK 17 for Spark latest

### Are these changes tested?

Will test in CI

### Are there any user-facing changes?

No
* Closes: apache#38060

Authored-by: Dane Pitkin <[email protected]>
Signed-off-by: Sutou Kouhei <[email protected]>
loicalleyne pushed a commit to loicalleyne/arrow that referenced this pull request Nov 13, 2023
### Rationale for this change

Spark released 3.5.0 and dropped support for Java 8 and 11 on main.

### What changes are included in this PR?

* Upgrade Spark integration tests from v3.4.1 -> 3.5.0
* Use JDK 17 for Spark latest

### Are these changes tested?

Will test in CI

### Are there any user-facing changes?

No
* Closes: apache#38060

Authored-by: Dane Pitkin <[email protected]>
Signed-off-by: Sutou Kouhei <[email protected]>
dgreiss pushed a commit to dgreiss/arrow that referenced this pull request Feb 19, 2024
### Rationale for this change

Spark released 3.5.0 and dropped support for Java 8 and 11 on main.

### What changes are included in this PR?

* Upgrade Spark integration tests from v3.4.1 -> 3.5.0
* Use JDK 17 for Spark latest

### Are these changes tested?

Will test in CI

### Are there any user-facing changes?

No
* Closes: apache#38060

Authored-by: Dane Pitkin <[email protected]>
Signed-off-by: Sutou Kouhei <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
awaiting merge Awaiting merge
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Python][CI] test-conda-python-3.11-spark-master fails, requires Java 17
2 participants