Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Batch load regions when building tikv coprocessor tasks #53850

Closed
you06 opened this issue Jun 6, 2024 · 1 comment · Fixed by #54153
Closed

Batch load regions when building tikv coprocessor tasks #53850

you06 opened this issue Jun 6, 2024 · 1 comment · Fixed by #54153
Labels
type/enhancement The issue or PR belongs to an enhancement.

Comments

@you06
Copy link
Contributor

you06 commented Jun 6, 2024

Enhancement

#51326 implements batch loading region cache for tiflash coprorcessor, this can also be used by tikv if we support batch load.

Further, there can be some optimizations:

  1. Support scan non-continuous region scanning.
  2. If there are some region cache hit in the given range, we can skip them.
@you06
Copy link
Contributor Author

you06 commented Jun 25, 2024

Result of test limit 1 case:

  1. split table into 1000 regions by SPLIT TABLE sbtest1 BETWEEN (0) AND (1000000) REGIONS 1000;
  2. wait until region cache expired.
  3. run a simple query explain analyze select * from sbtest1 limit 1;
  • Without this interface: ...build_task_duration: 81.5ms..., statmenet execution takes 0.11 sec
  • With this interface: ...build_task_duration: 2.7ms..., statement execution takes 0.02 sec

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
type/enhancement The issue or PR belongs to an enhancement.
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant