test: add nexmark with watermark planner test #9711
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
|
I tried but found it impossible for me to change the Flink's Nexamrk q7 to use standard hash inner join (by query hints) instead of interval join: #7244 (comment) |
lmatz
commented
May 9, 2023
src/frontend/planner_test/tests/testdata/nexmark_watermark.yaml
Outdated
Show resolved
Hide resolved
github-actions
bot
added
component/test
st1page
reviewed
May 10, 2023
src/frontend/planner_test/tests/testdata/nexmark_watermark.yaml
Outdated
Show resolved
Hide resolved
lmatz
force-pushed
the
lz/nexmark_watermark
branch
from
9edff4a to
918c051
Compare
|
Thanks, I updated |
lmatz
commented
May 11, 2023
| @@ -0,0 +1,2157 @@ | |||
| # This file is automatically generated. See `src/frontend/planner_test/README.md` for more information. | |||
| - id: create_sources | |||
| sql: "CREATE SOURCE nexmark (\n event_type BIGINT,\n person STRUCT<\"id\" BIGINT,\n \"name\" VARCHAR,\n \"email_address\" VARCHAR,\n \"credit_card\" VARCHAR,\n \"city\" VARCHAR,\n \"state\" VARCHAR,\n \"date_time\" TIMESTAMP,\n \"extra\" VARCHAR>,\n auction STRUCT<\"id\" BIGINT,\n \"item_name\" VARCHAR,\n \"description\" VARCHAR,\n \"initial_bid\" BIGINT,\n \"reserve\" BIGINT,\n \"date_time\" TIMESTAMP,\n \"expires\" TIMESTAMP,\n \"seller\" BIGINT,\n \"category\" BIGINT,\n \"extra\" VARCHAR>,\n bid STRUCT<\"auction\" BIGINT,\n \"bidder\" BIGINT,\n \"price\" BIGINT,\n \"channel\" VARCHAR,\n \"url\" VARCHAR,\n \"date_time\" TIMESTAMP,\n \"extra\" VARCHAR>,\n date_time TIMESTAMP AS\n CASE\n WHEN event_type = 0 THEN (person).date_time\n WHEN event_type = 1 THEN (auction).date_time\n ELSE (bid).date_time\n END,\n WATERMARK FOR date_time AS date_time - INTERVAL '4' SECOND\n) WITH (\n connector = 'nexmark',\n nexmark.split.num = '2',\n nexmark.min.event.gap.in.ns = '100'\n);\n\nCREATE VIEW PERSON as \nselect \n (person).id, (person).name, (person).email_address, (person).credit_card, (person).city, (person).state, \n date_time, (person).extra\nfrom \n nexmark \nwhere event_type = 0;\n\nCREATE VIEW AUCTION as \nselect \n (auction).id, (auction).item_name, (auction).description, (auction).initial_bid, (auction).reserve, date_time,\n (auction).expires, (auction).seller, (auction).category, (auction).extra\nfrom \n nexmark \nwhere event_type = 1;\n\nCREATE VIEW BID as \nselect \n (bid).auction, (bid).bidder, (bid).price, (bid).channel, (bid).url, date_time, (bid).extra\nfrom \n nexmark \nwhere event_type = 2;\n" | |||
There was a problem hiding this comment.
....
I wrote in the normal way
and the generator compressed them into a single-line string...
|
If it's good, then I will start to use them in the daily performance test |
st1page
approved these changes
May 15, 2023
|
Btw, can you help to add |
|
Might be related: #9588. There're too many possible combinations! 😄
|
sure, updated it |
Codecov Report
@@ Coverage Diff @@
## main #9711 +/- ##
==========================================
+ Coverage 70.98% 71.00% +0.01%
==========================================
Files 1246 1246
Lines 208377 208377
==========================================
+ Hits 147918 147950 +32
+ Misses 60459 60427 -32
Flags with carried forward coverage won't be shown. Click here to find out more. see 16 files with indirect coverage changes 📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more |
chenzl25
approved these changes
May 15, 2023
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
I hereby agree to the terms of the RisingWave Labs, Inc. Contributor License Agreement.
What's changed and what's your intention?