Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Restore defaultListWorkflowsPageSize back to 1000 (from 100) #4674

Merged
merged 1 commit into from
Jul 24, 2023

Conversation

hehaifengcn
Copy link
Contributor

@hehaifengcn hehaifengcn commented Jul 24, 2023

What changed?

Why?
GenerateReplicationTasks and VerifyReplicationTasks runs in parallel. VerifyReplicationTasks runs every 5s. Verification is not instantaneous, which means for every batch, Verification can delay at least 5s. Increase batch size, reduce the ration of the delay in batch processing.
Before the change, RPS for GenerateReplicationTasks + VerifyReplicationTasks is 30 RPS. With the change RPS is 90.

How did you test it?
Cluster test.

Potential risks

Is hotfix candidate?
Yes.

@hehaifengcn hehaifengcn requested a review from a team as a code owner July 24, 2023 17:04
@hehaifengcn hehaifengcn requested review from yux0 and wxing1292 July 24, 2023 18:13
@hehaifengcn hehaifengcn merged commit 48d3107 into master Jul 24, 2023
@hehaifengcn hehaifengcn deleted the haifengh/large-batch-size branch July 24, 2023 18:17
mindaugasrukas pushed a commit that referenced this pull request Jul 24, 2023
<!-- Describe what has changed in this PR -->
**What changed?**


<!-- Tell your future self why have you made these changes -->
**Why?**
GenerateReplicationTasks and VerifyReplicationTasks runs in parallel.
VerifyReplicationTasks runs every 2s. Verification is not instantaneous,
which means for every batch, Verification can delay at least 5s.
Increase batch size, reduce the ration of the delay in batch processing.
Before the change, RPS for GenerateReplicationTasks +
VerifyReplicationTasks is 30 RPS. With the change RPS is 90.

<!-- How have you verified this change? Tested locally? Added a unit
test? Checked in staging env? -->
**How did you test it?**
Cluster test. 

<!-- Assuming the worst case, what can be broken when deploying this
change to production? -->
**Potential risks**


<!-- Is this PR a hotfix candidate or require that a notification be
sent to the broader community? (Yes/No) -->
**Is hotfix candidate?**
Yes.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants