Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

CDC resolved ts and checkpoint lag unstable and up to 2min #11060

Closed
fubinzh opened this issue May 9, 2024 · 4 comments
Closed

CDC resolved ts and checkpoint lag unstable and up to 2min #11060

fubinzh opened this issue May 9, 2024 · 4 comments
Assignees
@hicqu
Labels
area/ticdc Issues or PRs related to TiCDC. severity/major type/bug The issue is confirmed as a bug.

Comments

@fubinzh
Copy link

fubinzh commented May 9, 2024

What did you do?

  1. Deploy TiDB cluster with 2 CDC nodes (16c32g)
  2. Create kafka simple protocol changefeed
  3. Run workload for 4k tables (row width: 1.8k, cdc throughtput ~12k

What did you expect to see?

CDC lag should be stable

What did you see instead?

CDC resolve ts and checkpoint lag are very unstable, up to 2min sometimes.
image

Versions of the cluster

Release Version: v7.5.2-pr11031
Git Commit Hash: dd48f9e
Git Branch: heads/refs/tags/v7.5.2-pr11031
UTC Build Time: 2024-05-07 04:49:30
Go Version: go version go1.21.6 linux/amd64
Failpoint Build: false
@fubinzh fubinzh added area/ticdc Issues or PRs related to TiCDC. type/bug The issue is confirmed as a bug. labels May 9, 2024
@fubinzh
Copy link
Author

fubinzh commented May 9, 2024

/severity major

@fubinzh
Copy link
Author

fubinzh commented May 9, 2024

/label affects-7.5

@ti-chi-bot ti-chi-bot bot added affects-7.5 This bug affects the 7.5.x(LTS) versions. and removed may-affects-7.5 labels May 9, 2024
@fubinzh
Copy link
Author

fubinzh commented May 9, 2024

/assign @hicqu

@asddongmen
Copy link
Contributor

Duplicated with #11078

@flowbehappy flowbehappy removed affects-7.5 This bug affects the 7.5.x(LTS) versions. affects-8.1 This bug affects the 8.1.x(LTS) versions. labels May 28, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@hicqu hicqu

Labels
area/ticdc Issues or PRs related to TiCDC. severity/major type/bug The issue is confirmed as a bug.
Projects
Question and Bug Reports
Status: Done
Milestone
No milestone
Development

No branches or pull requests
4 participants
@flowbehappy @fubinzh @hicqu @asddongmen