Add an E2E test suite for multi-datacenter clusters

[rzetelskik]

Description of your changes: This PR introduces a multi-datacenter E2E test suite with a basic test verifying a multi-datacenter cluster can form across multiple Kubernetes clusters, using external seeds to connect datacenters.

Which issue is resolved by this Pull Request:
Resolves

Requires:

• Propagate kubeconfigs to e2e Pod #1951
• Support overriding deploy dir in deploy script #1952

/kind feature
/priority important-longterm
/cc

[scylla-operator-bot]

Skipping CI for Draft Pull Request.
If you want CI signal for your change, please convert it to an actual PR.
You can still manually trigger a test run with /test all

[scylla-operator-bot]

@rzetelskik: GitHub didn't allow me to request PR reviews from the following users: rzetelskik.

Note that only scylladb members and repo collaborators can review this PR, and authors cannot review their own PRs.

In response to this:

Description of your changes: This PR introduces a multi-datacenter E2E test suite with a basic test verifying a multi-datacenter cluster can form across multiple Kubernetes clusters, using external seeds to connect datacenters.

Which issue is resolved by this Pull Request:
Resolves #1320

Requires:

• Propagate kubeconfigs to e2e Pod #1951
• Support overriding deploy dir in deploy script #1952
• https://github.com/scylladb/scylla-operator-release/pull/81

/kind feature
/priority important-longterm
/cc

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

[rzetelskik]

This will only be able to run once https://github.com/scylladb/scylla-operator-release/pull/81 is unblocked, but should be ready for review by itself.
/cc zimnx
/assign zimnx

[rzetelskik]

/retest
cluster provisioning failed

[rzetelskik]

/hold
for an optional presubmit with multi-datacenter infra

[rzetelskik]

/hold cancel
@zimnx presubmit passed, ready for review

[rzetelskik]

/test e2e-gke-multi-datacenter-parallel

[rzetelskik]

@rzetelskik: The following test failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
ci/prow/e2e-gke-parallel-clusterip 946dc9a link true /test e2e-gke-parallel-clusterip
Full PR test history. Your PR dashboard.

#1028 (comment)
unrelated
/retest

[zimnx]

lgtm
/assign tnozicka

[rzetelskik]

/test images e2e-gke-parallel-clusterip

[tnozicka]

thanks for the updates, 2 nits
/approve

[scylla-operator-bot]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: rzetelskik, tnozicka, zimnx

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• OWNERS [tnozicka,zimnx]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[rzetelskik]

thanks for the updates, 2 nits /approve

Applied. Also aligned Cluster/Namespace/ScyllaCluster indexing, I forgot about it earlier.

[tnozicka]

thx, that one was truly optional

/lgtm

[scylla-operator-bot]

@rzetelskik: The following test failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name	Commit	Details	Required	Rerun command
ci/prow/e2e-gke-multi-datacenter-parallel	ce7c5d7	link	false	/test e2e-gke-multi-datacenter-parallel

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

[rzetelskik]

@rzetelskik: The following test failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
ci/prow/e2e-gke-multi-datacenter-parallel ce7c5d7 link false /test e2e-gke-multi-datacenter-parallel
Full PR test history. Your PR dashboard.

Invalid value: "a ": a valid label must be an empty string or consist of alphanumeric characters, '-', '_' or '.', and must start and end with an alphanumeric character (e.g. 'MyValue',  or 'my_value',  or '12345', regex used for validation is '(([A-Za-z0-9][-A-Za-z0-9_.]*)?[A-Za-z0-9])?')

Didn't notice a whitespace there...
Fixed, @tnozicka please tag again.

[tnozicka]

/lgtm