Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Adding a new config skipSegmentPreprocess in table IndexingConfig #14982

Merged
merged 1 commit into from
Feb 4, 2025

Conversation

xiangfu0
Copy link
Contributor

@xiangfu0 xiangfu0 commented Feb 4, 2025

This config: skipSegmentPreprocess in TableConfig-> IndexingConfig allows the table to skip preprocess during server startup or reload.

@xiangfu0 xiangfu0 requested a review from Jackie-Jiang February 4, 2025 00:15
@xiangfu0 xiangfu0 added the Configuration Config changes (addition/deletion/change in behavior) label Feb 4, 2025
@xiangfu0 xiangfu0 force-pushed the allow-skip-segment-preprocess branch 2 times, most recently from 27ee253 to ac474c9 Compare February 4, 2025 00:47
@xiangfu0 xiangfu0 requested a review from Jackie-Jiang February 4, 2025 00:50
@xiangfu0 xiangfu0 force-pushed the allow-skip-segment-preprocess branch from ac474c9 to 45dbdfb Compare February 4, 2025 01:26
@codecov-commenter
Copy link

codecov-commenter commented Feb 4, 2025

Codecov Report

Attention: Patch coverage is 50.00000% with 3 lines in your changes missing coverage. Please review.

Project coverage is 63.70%. Comparing base (59551e4) to head (45dbdfb).
Report is 1668 commits behind head on master.

Files with missing lines Patch % Lines
...indexsegment/immutable/ImmutableSegmentLoader.java 0.00% 1 Missing and 1 partial ⚠️
...local/segment/index/loader/IndexLoadingConfig.java 0.00% 0 Missing and 1 partial ⚠️
Additional details and impacted files
@@             Coverage Diff              @@
##             master   #14982      +/-   ##
============================================
+ Coverage     61.75%   63.70%   +1.94%     
- Complexity      207     1480    +1273     
============================================
  Files          2436     2713     +277     
  Lines        133233   152171   +18938     
  Branches      20636    23526    +2890     
============================================
+ Hits          82274    96935   +14661     
- Misses        44911    47943    +3032     
- Partials       6048     7293    +1245     
Flag Coverage Δ
custom-integration1 100.00% <ø> (+99.99%) ⬆️
integration 100.00% <ø> (+99.99%) ⬆️
integration1 100.00% <ø> (+99.99%) ⬆️
integration2 0.00% <ø> (ø)
java-11 63.67% <50.00%> (+1.96%) ⬆️
java-21 63.57% <50.00%> (+1.95%) ⬆️
skip-bytebuffers-false 63.69% <50.00%> (+1.94%) ⬆️
skip-bytebuffers-true 63.53% <50.00%> (+35.80%) ⬆️
temurin 63.70% <50.00%> (+1.94%) ⬆️
unittests 63.69% <50.00%> (+1.94%) ⬆️
unittests1 56.24% <50.00%> (+9.35%) ⬆️
unittests2 34.02% <50.00%> (+6.29%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@xiangfu0 xiangfu0 changed the title Adding a new config enableSegmentPreprocess in table IndexingConfig Adding a new config skipSegmentPreprocess in table IndexingConfig Feb 4, 2025
@xiangfu0 xiangfu0 merged commit 3c02ec4 into apache:master Feb 4, 2025
20 of 21 checks passed
@xiangfu0 xiangfu0 deleted the allow-skip-segment-preprocess branch February 4, 2025 07:01
zeronerdzerogeekzerocool pushed a commit to zeronerdzerogeekzerocool/pinot that referenced this pull request Feb 20, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Configuration Config changes (addition/deletion/change in behavior) documentation ingestion
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants