Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Introduce sharding rules to MongoDB collections #530

Closed
hackerwins opened this issue May 11, 2023 · 1 comment
Closed

Introduce sharding rules to MongoDB collections #530

hackerwins opened this issue May 11, 2023 · 1 comment
Assignees
Labels
enhancement 🌟 New feature or request hard 🧑‍🔬 Difficult to deal with or require research

Comments

@hackerwins
Copy link
Member

hackerwins commented May 11, 2023

Description:

This description is written by @sejongk

To address the load concentrated on the database, we need to introduce a MongoDB Sharded Cluster and apply appropriate sharding rules to the collections for a solution.

Why:

The Yorkie cluster stores almost all data, including documents and changes representing edits, in MongoDB. It has been observed that in real-world service scenarios, the majority of the load is concentrated on the database rather than the application servers, as was the case with Yorkie's predecessor, Kaleido.

@hackerwins hackerwins added the enhancement 🌟 New feature or request label May 11, 2023
@hackerwins hackerwins added the good first issue 🐤 Good for newcomers label Jun 7, 2023
@hackerwins hackerwins removed the good first issue 🐤 Good for newcomers label Jul 3, 2023
@sejongk
Copy link
Contributor

sejongk commented Aug 2, 2023

We need to determine which sharding method is appropriate for Yorkie and what kinds of sharding method MongoDB supports.
For example, ranged sharding would be efficient if a range of documents is frequently queried. Additionally, hash sharding would be ideal for massively-scalable workloads because it distributes data evenly.

@sejongk sejongk self-assigned this Sep 11, 2023
@hackerwins hackerwins moved this from Todo to In Progress in Yorkie Project Oct 23, 2023
@sejongk sejongk mentioned this issue Nov 2, 2023
2 tasks
@hackerwins hackerwins added the hard 🧑‍🔬 Difficult to deal with or require research label Nov 8, 2023
@github-project-automation github-project-automation bot moved this from In Progress to Done in Yorkie Project Nov 9, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement 🌟 New feature or request hard 🧑‍🔬 Difficult to deal with or require research
Projects
No open projects
Status: Done
Development

No branches or pull requests

2 participants