Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[KYUUBI#2405] Support Flink StringData Data Type #2718

Closed
wants to merge 7 commits into from

Conversation

link3280
Copy link
Contributor

@link3280 link3280 commented May 22, 2022

Why are the changes needed?

Currently, Flink uses its legacy data type system in CollectSink, but sooner would move to the new type system (see https://issues.apache.org/jira/browse/FLINK-12251). Kyuubi should adapt to the new data type system beforehand.

This PR supports StringData in Flink.

This is a subtask of #2100 .

How was this patch tested?

  • Add some test cases that check the changes thoroughly including negative and positive cases if possible

  • Add screenshots for manual tests if appropriate

  • Run test locally before make a pull request

@pan3793
Copy link
Member

pan3793 commented May 22, 2022

Thanks @link3280, could you please add the FLINK JIRA ticket link about the change you described?

@link3280
Copy link
Contributor Author

@pan3793 Sure. Updated.

@codecov-commenter
Copy link

codecov-commenter commented May 22, 2022

Codecov Report

Merging #2718 (951b20a) into master (45531f0) will decrease coverage by 2.89%.
The diff coverage is 65.38%.

@@             Coverage Diff              @@
##             master    #2718      +/-   ##
============================================
- Coverage     64.82%   61.92%   -2.90%     
+ Complexity      279      238      -41     
============================================
  Files           409      406       -3     
  Lines         19661    19603      -58     
  Branches       2638     2632       -6     
============================================
- Hits          12745    12140     -605     
- Misses         5706     6298     +592     
+ Partials       1210     1165      -45     
Impacted Files Coverage Δ
...org/apache/kyuubi/engine/flink/schema/RowSet.scala 65.82% <65.38%> (+10.95%) ⬆️
...pache/kyuubi/sql/KyuubiSQLExtensionException.scala 0.00% <0.00%> (-100.00%) ⬇️
...rg/apache/kyuubi/sql/zorder/ZorderBytesUtils.scala 0.00% <0.00%> (-94.74%) ⬇️
...ubi/sql/zorder/InsertZorderBeforeWritingBase.scala 0.00% <0.00%> (-89.16%) ⬇️
...cala/org/apache/kyuubi/sql/zorder/ZorderBase.scala 0.00% <0.00%> (-87.50%) ⬇️
.../kyuubi/sql/zorder/OptimizeZorderCommandBase.scala 0.00% <0.00%> (-81.82%) ⬇️
...yuubi/sql/zorder/OptimizeZorderStatementBase.scala 0.00% <0.00%> (-71.43%) ⬇️
...g/apache/kyuubi/sql/zorder/ResolveZorderBase.scala 0.00% <0.00%> (-69.57%) ⬇️
...pache/kyuubi/sql/KyuubiQueryStagePreparation.scala 0.00% <0.00%> (-32.36%) ⬇️
...g/apache/kyuubi/sql/KyuubiEnsureRequirements.scala 0.00% <0.00%> (-30.19%) ⬇️
... and 8 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 45531f0...951b20a. Read the comment docs.

@link3280 link3280 closed this May 22, 2022
@link3280 link3280 reopened this May 22, 2022
Copy link
Contributor

@yanghua yanghua left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@pan3793 pan3793 added this to the v1.6.0 milestone May 23, 2022
@pan3793
Copy link
Member

pan3793 commented May 23, 2022

Thanks, merging to master

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants