Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Align sm-agent and Scylla object storage configurations #4211

Open
Michal-Leszczynski opened this issue Jan 15, 2025 · 0 comments
Open

Align sm-agent and Scylla object storage configurations #4211

Michal-Leszczynski opened this issue Jan 15, 2025 · 0 comments
Assignees

Comments

@Michal-Leszczynski
Copy link
Collaborator

Michal-Leszczynski commented Jan 15, 2025

The description of this issue and possible solutions can be found in this doc.

The problem is that sm-agent configures object storage access via scylla-manager-agent.yaml, but Scylla uses object_storage.yaml for this purpose. Those files have different formats and it's not obvious how to match object storage configurations between them.

One of the possible solutions to this problem is #4161, but we haven't yet decided if that's the way to go.

UPDATE:
We decided that Scylla will expose an endpoint which would (issue):

  • list object storage configurations
  • tell which configuration is the default

Extending location flag with endpoint instead of provider is still needed (issue).
If user runs backup/restore just with the provider specified, SM will:

  • use the default Scylla object storage configuration
  • use the Rclone configuration for specified provider
  • validate that both configurations match
    If user runs backup/restore with specified endpoint, SM will:
  • use the provided endpoint Scylla object storage configuration
  • use Rclone configuration for matching provider
  • validate that both configurations match

Note that different nodes might have different configurations, so the validation needs to be per node (even though we allow for specifying provider/endpoint only per DC with --location falg)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant