Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Revert "PartiQL Eval - Planner Mode (#1385)" #1425

Merged
merged 1 commit into from
Apr 11, 2024
Merged

Conversation

rchowell
Copy link
Contributor

Description

This reverts the planner mode as it made substantial changes to the planner which has already diverged from main. Let's get the merge from main in before adding these changes.

After merging #1420 — I will then re-apply the planner mode PR.

License Information

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

@rchowell rchowell requested a review from johnedquinn April 11, 2024 22:45
@rchowell rchowell merged commit 5f16e67 into v1 Apr 11, 2024
12 checks passed
Copy link

Conformance comparison report-Cross Engine

Base (legacy) eval +/-
% Passing 92.51% 82.43% -10.07%
✅ Passing 5382 4796 -586
❌ Failing 436 1022 586
🔶 Ignored 0 0 0
Total Tests 5818 5818 0
Number passing in both: 4624

Number failing in both: 264

Number passing in legacy engine but fail in eval engine: 758

Number failing in legacy engine but pass in eval engine: 172
⁉️ CONFORMANCE REPORT REGRESSION DETECTED ⁉️
The complete list can be found in GitHub CI summary, either from Step Summary or in the Artifact.
172 test(s) were failing in legacy but now pass in eval. Before merging, confirm they are intended to pass.
The complete list can be found in GitHub CI summary, either from Step Summary or in the Artifact.

Conformance comparison report-Cross Commit-LEGACY

Base (6103e9e) d421565 +/-
% Passing 92.52% 92.51% -0.02%
✅ Passing 5383 5382 -1
❌ Failing 435 436 1
🔶 Ignored 0 0 0
Total Tests 5818 5818 0
Number passing in both: 5382

Number failing in both: 435

Number passing in Base (6103e9e) but now fail: 1

Number failing in Base (6103e9e) but now pass: 0
⁉️ CONFORMANCE REPORT REGRESSION DETECTED ⁉️. The following test(s) were previously passing but now fail:

Click here to see
  • MYSQL_SELECT_29, compileOption: LEGACY

Conformance comparison report-Cross Commit-EVAL

Base (6103e9e) d421565 +/-
% Passing 82.85% 82.43% -0.42%
✅ Passing 4821 4796 -25
❌ Failing 998 1022 24
🔶 Ignored 0 0 0
Total Tests 5819 5818 -1
Number passing in both: 4745

Number failing in both: 946

Number passing in Base (6103e9e) but now fail: 76

Number failing in Base (6103e9e) but now pass: 52
⁉️ CONFORMANCE REPORT REGRESSION DETECTED ⁉️
The complete list can be found in GitHub CI summary, either from Step Summary or in the Artifact.
52 test(s) were previously failing but now pass. Before merging, confirm they are intended to pass
The complete list can be found in GitHub CI summary, either from Step Summary or in the Artifact.

@rchowell rchowell deleted the planner-mode-revert branch July 18, 2024 21:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants