Add table gcp_dataproc_metastore_service Closes #652

[ParthaI]

Integration test logs

Logs

No env file present for the current environment:  staging 
 Falling back to .env config
No env file present for the current environment:  staging
customEnv TURBOT_TEST_EXPECTED_TIMEOUT undefined

SETUP: tests/gcp_dataproc_metastore_service []

PRETEST: tests/gcp_dataproc_metastore_service

TEST: tests/gcp_dataproc_metastore_service
Running terraform
data.google_client_config.current: Reading...
data.google_client_config.current: Read complete after 1s [id=projects/"parker-aaa"/regions/"us-east1"/zones/"us-east1-b"]
data.null_data_source.resource: Reading...
data.null_data_source.resource: Read complete after 0s [id=static]

Terraform used the selected providers to generate the following execution
plan. Resource actions are indicated with the following symbols:
  + create

Terraform will perform the following actions:

  # google_dataproc_metastore_service.named_test_resource will be created
  + resource "google_dataproc_metastore_service" "named_test_resource" {
      + artifact_gcs_uri = (known after apply)
      + database_type    = "MYSQL"
      + effective_labels = {
          + "env"                        = "test"
          + "goog-terraform-provisioned" = "true"
        }
      + endpoint_uri     = (known after apply)
      + id               = (known after apply)
      + labels           = {
          + "env" = "test"
        }
      + location         = "us-east1"
      + name             = (known after apply)
      + network          = (known after apply)
      + port             = 9080
      + project          = "parker-aaa"
      + release_channel  = "STABLE"
      + service_id       = "turbottest80456"
      + state            = (known after apply)
      + state_message    = (known after apply)
      + terraform_labels = {
          + "env"                        = "test"
          + "goog-terraform-provisioned" = "true"
        }
      + tier             = "DEVELOPER"
      + uid              = (known after apply)

      + hive_metastore_config {
          + config_overrides  = (known after apply)
          + endpoint_protocol = "THRIFT"
          + version           = "2.3.6"
        }

      + maintenance_window {
          + day_of_week = "SUNDAY"
          + hour_of_day = 2
        }
    }

Plan: 1 to add, 0 to change, 0 to destroy.

Changes to Outputs:
  + project_id    = "parker-aaa"
  + resource_aka  = (known after apply)
  + resource_id   = (known after apply)
  + resource_name = "turbottest80456"
  + state         = (known after apply)
  + uid           = (known after apply)
google_dataproc_metastore_service.named_test_resource: Creating...
google_dataproc_metastore_service.named_test_resource: Still creating... [10s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [20s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [30s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [40s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [50s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [1m0s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [1m10s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [1m20s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [1m30s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [1m40s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [1m50s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [2m0s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [2m10s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [2m20s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [2m30s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [2m40s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [2m50s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [3m0s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [3m10s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [3m20s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [3m30s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [3m40s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [3m50s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [4m0s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [4m10s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [4m20s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [4m30s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [4m40s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [4m50s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [5m0s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [5m10s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [5m20s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [5m30s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [5m40s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [5m50s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [6m0s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [6m10s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [6m20s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [6m30s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [6m40s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [6m50s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [7m0s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [7m10s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [7m20s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [7m30s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [7m40s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [7m50s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [8m0s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [8m10s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [8m20s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [8m30s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [8m40s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [8m50s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [9m0s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [9m10s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [9m20s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [9m30s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [9m40s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [9m50s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [10m0s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [10m10s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [10m20s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [10m30s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [10m40s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [10m50s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [11m0s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [11m10s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [11m20s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [11m30s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [11m40s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [11m50s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [12m0s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [12m10s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [12m20s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [12m30s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [12m40s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [12m50s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [13m0s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [13m10s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [13m20s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [13m30s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [13m40s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [13m50s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [14m0s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [14m10s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [14m20s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [14m30s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [14m40s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [14m50s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [15m0s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [15m10s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [15m20s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [15m30s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [15m40s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [15m50s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [16m0s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [16m10s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [16m20s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [16m30s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [16m40s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [16m50s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [17m0s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [17m10s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [17m20s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [17m30s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [17m40s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [17m50s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [18m0s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [18m10s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [18m20s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [18m30s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [18m40s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [18m50s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [19m0s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [19m10s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [19m20s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [19m30s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [19m40s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [19m50s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [20m0s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [20m10s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [20m20s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [20m30s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [20m40s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [20m50s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [21m0s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [21m10s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [21m20s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [21m30s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [21m40s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [21m50s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [22m0s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [22m10s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [22m20s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [22m30s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [22m40s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [22m50s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [23m0s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [23m10s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [23m20s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [23m30s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [23m40s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [23m50s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [24m0s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [24m10s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [24m20s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [24m30s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [24m40s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [24m50s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [25m0s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [25m10s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [25m20s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [25m30s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [25m40s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [25m50s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [26m0s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [26m10s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [26m20s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [26m30s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [26m40s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [26m50s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [27m0s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [27m10s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [27m20s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [27m30s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [27m40s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [27m50s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [28m0s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [28m10s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [28m20s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [28m30s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [28m40s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [28m50s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [29m0s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [29m10s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [29m20s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [29m30s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [29m40s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [29m50s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [30m0s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [30m10s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [30m20s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [30m30s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [30m40s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [30m50s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [31m0s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [31m10s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [31m20s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [31m30s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [31m40s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [31m50s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [32m0s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [32m10s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [32m20s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [32m30s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [32m40s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [32m50s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [33m0s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [33m10s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [33m20s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [33m30s elapsed]
google_dataproc_metastore_service.named_test_resource: Still creating... [33m40s elapsed]
google_dataproc_metastore_service.named_test_resource: Creation complete after 33m48s [id=projects/parker-aaa/locations/us-east1/services/turbottest80456]

Warning: Deprecated

  with data.null_data_source.resource,
  on variables.tf line 33, in data "null_data_source" "resource":
  33: data "null_data_source" "resource" {

The null_data_source was historically used to construct intermediate values
to re-use elsewhere in configuration, the same can now be achieved using
locals or the terraform_data resource type in Terraform 1.4 and later.

(and one more similar warning elsewhere)

Apply complete! Resources: 1 added, 0 changed, 0 destroyed.

Outputs:

project_id = "parker-aaa"
resource_aka = "gcp://metastore.googleapis.com/projects/parker-aaa/locations/us-east1/services/turbottest80456"
resource_id = "projects/parker-aaa/locations/us-east1/services/turbottest80456"
resource_name = "turbottest80456"
state = "ACTIVE"
uid = "f74ba2ee-e832-4270-95f4-33bf5e1de096"

Running SQL query: test-get-query.sql

Time: 5.8s. Rows returned: 1. Rows fetched: 1. Hydrate calls: 0.

Scans:
  1) gcp_dataproc_metastore_service.gcp: Time: 5.6s. Fetched: 1. Hydrates: 0. Quals: name=projects/parker-aaa/locations/us-east1/services/turbottest80456.

[
  {
    "name": "projects/parker-aaa/locations/us-east1/services/turbottest80456",
    "project": "parker-aaa",
    "state": "ACTIVE",
    "title": "turbottest80456",
    "uid": "f74ba2ee-e832-4270-95f4-33bf5e1de096"
  }
]
✔ PASSED

Running SQL query: test-list-query.sql

Time: 5.4s. Rows returned: 1. Rows fetched: 2. Hydrate calls: 2.

Scans:
  1) gcp_dataproc_metastore_service.gcp: Time: 4.5s. Fetched: 2. Hydrates: 2.

[
  {
    "akas": [
      "gcp://metastore.googleapis.com/projects/parker-aaa/locations/us-east1/services/turbottest80456"
    ],
    "name": "projects/parker-aaa/locations/us-east1/services/turbottest80456",
    "project": "parker-aaa",
    "title": "turbottest80456"
  }
]
✔ PASSED

Running SQL query: test-notfound-query.sql

Time: 7.1s. Rows returned: 0.
[]
✔ PASSED

Running SQL query: test-turbot-query.sql

Time: 7.9s. Rows returned: 0.
[
  {
    "akas": [
      "gcp://metastore.googleapis.com/projects/parker-aaa/locations/us-east1/services/turbottest80456"
    ],
    "title": "turbottest80456"
  }
]
✔ PASSED

TEARDOWN: tests/gcp_dataproc_metastore_service

SUMMARY:

1/1 passed.

Example query results

Results

> select * from gcp_dataproc_metastore_service where name = 'projects/parker-aaa/locations/us-central1/services/service-9c73'
+-----------------------------------------------------------------+-------------------------------------------------------------------+---------------------------+---------------+----------------------------+------+--------------------------------------+---------------------------+-------------------------------->
| name                                                            | artifact_gcs_uri                                                  | create_time               | database_type | endpoint_uri               | tier | uid                                  | update_time               | network                        >
+-----------------------------------------------------------------+-------------------------------------------------------------------+---------------------------+---------------+----------------------------+------+--------------------------------------+---------------------------+-------------------------------->
| projects/parker-aaa/locations/us-central1/services/service-9c73 | gs://gcs-bucket-service-9c73-f7c0910e-6ebf-43b2-a716-fb6316b2fcba | 2024-09-10T10:51:22+05:30 | SPANNER       | thrift://10.81.192.29:9083 |      | f7c0910e-6ebf-43b2-a716-fb6316b2fcba | 2024-09-10T11:10:43+05:30 | projects/parker-aaa/global/netw>
+-----------------------------------------------------------------+-------------------------------------------------------------------+---------------------------+---------------+----------------------------+------+--------------------------------------+---------------------------+-------------------------------->