Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

importer: increase default batch, job_count, worker_count. #3

Merged
merged 3 commits into from
Jun 29, 2017

Conversation

holys
Copy link
Contributor

@holys holys commented Jun 28, 2017

The previous default batch value is 1, which is too slow.

@GregoryIan @iamxy PTAL

fs.IntVar(&cfg.WorkerCount, "c", 1, "parallel worker count")
fs.IntVar(&cfg.JobCount, "n", 1, "total job count")
fs.IntVar(&cfg.Batch, "b", 1, "insert batch commit count")
fs.IntVar(&cfg.WorkerCount, "c", 2, "parallel worker count")
Copy link
Collaborator

@IANTHEREAL IANTHEREAL Jun 28, 2017

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

2? 16 come on

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I make it 2 because default JobCount is 10000;

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

how about 10,1000,10000?

@IANTHEREAL
Copy link
Collaborator

LGTM

@IANTHEREAL IANTHEREAL merged commit 47b7826 into master Jun 29, 2017
@IANTHEREAL IANTHEREAL deleted the chendahui/importer-incr-batch branch June 29, 2017 03:53
3pointer pushed a commit to 3pointer/tidb-tools that referenced this pull request Oct 29, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants