Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Test failure: test_job_spark_python_task_linter_unhappy_path #2845

Closed
github-actions bot opened this issue Oct 5, 2024 · 3 comments · Fixed by #2852 or #2853
Closed

Test failure: test_job_spark_python_task_linter_unhappy_path #2845

github-actions bot opened this issue Oct 5, 2024 · 3 comments · Fixed by #2852 or #2853
Assignees
@JCZuurmond

Comments

@github-actions
Copy link

github-actions bot commented Oct 5, 2024

❌ test_job_spark_python_task_linter_unhappy_path: assert 0 == 1 (9.81s) 
assert 0 == 1
 +  where 0 = len([])
05:18 INFO [databricks.sdk] Using Databricks Metadata Service authentication
05:18 INFO [databricks.sdk] Using Databricks Metadata Service authentication
[gw7] linux -- Python 3.10.15 /home/runner/work/ucx/ucx/.venv/bin/python
05:18 INFO [databricks.sdk] Using Databricks Metadata Service authentication
05:18 INFO [databricks.sdk] Using Databricks Metadata Service authentication
05:18 INFO [databricks.labs.pytester.fixtures.notebooks] Created folder: https://DATABRICKS_HOST#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-03LV-ra78a5529b
05:18 INFO [databricks.labs.pytester.fixtures.notebooks] Created notebook: https://DATABRICKS_HOST#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-03LV-ra78a5529b/notebook.py
05:18 INFO [databricks.labs.pytester.fixtures.baseline] Created dummy-1AOJ: https://DATABRICKS_HOST/compute/clusters/1005-051858-v9rm75j2
05:18 INFO [databricks.labs.pytester.fixtures.notebooks] Created notebook: https://DATABRICKS_HOST#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-79mv-ra78a5529b
05:18 INFO [databricks.labs.pytester.fixtures.baseline] Created dummy-oUPI: https://DATABRICKS_HOST/job/604357884143965
05:18 INFO [databricks.labs.pytester.fixtures.baseline] Created hive_metastore.dummy_sesav schema: https://DATABRICKS_HOST/#explore/data/hive_metastore/dummy_sesav
05:19 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.kJpp/config.yml) doesn't exist.
05:19 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Inventory Database stored in hive_metastore
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Catalog to store UCX artifacts in
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Log level
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Number of threads
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Backup prefix
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: �[1mChoose how to map the workspace groups:�[0m
�[1m[0]�[0m �[36mMatch by Name�[0m
�[1m[1]�[0m �[36mApply a Prefix�[0m
�[1m[2]�[0m �[36mApply a Suffix�[0m
�[1m[3]�[0m �[36mMatch by External ID�[0m
�[1m[4]�[0m �[36mRegex Substitution�[0m
�[1m[5]�[0m �[36mRegex Matching�[0m
Enter a number between 0 and 5
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Enter a prefix to add to the workspace group name
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Comma-separated list of workspace group names to migrate. If not specified, we'll use all account-level groups with matching names to workspace-level groups
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Comma-separated list of databases to migrate. If not specified, we'll use all databases in hive_metastore
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Does given workspace 414838440637730 block Internet access?
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Do you want to trigger assessment job after installation?
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Reconciliation threshold, in percentage
05:19 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data.
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: No HMS lineage collection init script exists, do you want to create one?
05:19 INFO [databricks.labs.ucx.install] Fetching installations...
05:19 INFO [databricks.labs.blueprint.parallel] finding kJpp installations 100/101, rps: 223.957/sec
05:19 INFO [databricks.labs.blueprint.parallel] finding kJpp installations 101/101, rps: 223.217/sec
05:19 INFO [databricks.labs.blueprint.parallel] Finished 'finding kJpp installations' tasks: 0% results available (0/101). Took 0:00:00.453089
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: �[1mSelect PRO or SERVERLESS SQL warehouse to run assessment dashboards on�[0m
�[1m[0]�[0m �[36m[Create new PRO SQL warehouse]�[0m
�[1m[1]�[0m �[36mDEFAULT Test Warehouse (TEST_DEFAULT_WAREHOUSE_ID, SERVERLESS, RUNNING)�[0m
Enter a number between 0 and 1
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Instance pool id to be set in cluster policy for all workflow clusters
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: We have identified one or more cluster policies set up for an external metastore. Would you like to set UCX to connect to the external metastore?
05:19 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Parallelism for migrating dbfs root delta tables with deep clone
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Min workers for auto-scale job cluster for table migration
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Max workers for auto-scale job cluster for table migration
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Open config file in the browser and continue installing? https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.kJpp/config.yml
05:19 DEBUG [tests.integration.conftest] Waiting for clusters to start...
05:19 INFO [databricks.labs.blueprint.parallel] ensure clusters running 3/3, rps: 60.775/sec
05:19 INFO [databricks.labs.blueprint.parallel] Finished 'ensure clusters running' tasks: 0% results available (0/3). Took 0:00:00.049610
05:19 DEBUG [tests.integration.conftest] Waiting for clusters to start...
05:19 INFO [databricks.labs.pytester.fixtures.baseline] Created ucx_zsb6inSw41lr8TlF catalog: https://DATABRICKS_HOST/#explore/data/ucx_zsb6inSw41lr8TlF
05:19 INFO [databricks.labs.ucx.source_code.jobs] Discovering qMUm entrypoint: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-03LV-ra78a5529b/notebook.py
05:19 INFO [databricks.labs.ucx.source_code.jobs] Linting qMUm dependency: Dependency</Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-03LV-ra78a5529b/notebook.py>
05:18 INFO [databricks.sdk] Using Databricks Metadata Service authentication
05:18 INFO [databricks.sdk] Using Databricks Metadata Service authentication
05:18 INFO [databricks.labs.pytester.fixtures.notebooks] Created folder: https://DATABRICKS_HOST#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-03LV-ra78a5529b
05:18 INFO [databricks.labs.pytester.fixtures.notebooks] Created notebook: https://DATABRICKS_HOST#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-03LV-ra78a5529b/notebook.py
05:18 INFO [databricks.labs.pytester.fixtures.baseline] Created dummy-1AOJ: https://DATABRICKS_HOST/compute/clusters/1005-051858-v9rm75j2
05:18 INFO [databricks.labs.pytester.fixtures.notebooks] Created notebook: https://DATABRICKS_HOST#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-79mv-ra78a5529b
05:18 INFO [databricks.labs.pytester.fixtures.baseline] Created dummy-oUPI: https://DATABRICKS_HOST/job/604357884143965
05:18 INFO [databricks.labs.pytester.fixtures.baseline] Created hive_metastore.dummy_sesav schema: https://DATABRICKS_HOST/#explore/data/hive_metastore/dummy_sesav
05:19 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.kJpp/config.yml) doesn't exist.
05:19 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Inventory Database stored in hive_metastore
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Catalog to store UCX artifacts in
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Log level
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Number of threads
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Backup prefix
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: �[1mChoose how to map the workspace groups:�[0m
�[1m[0]�[0m �[36mMatch by Name�[0m
�[1m[1]�[0m �[36mApply a Prefix�[0m
�[1m[2]�[0m �[36mApply a Suffix�[0m
�[1m[3]�[0m �[36mMatch by External ID�[0m
�[1m[4]�[0m �[36mRegex Substitution�[0m
�[1m[5]�[0m �[36mRegex Matching�[0m
Enter a number between 0 and 5
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Enter a prefix to add to the workspace group name
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Comma-separated list of workspace group names to migrate. If not specified, we'll use all account-level groups with matching names to workspace-level groups
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Comma-separated list of databases to migrate. If not specified, we'll use all databases in hive_metastore
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Does given workspace 414838440637730 block Internet access?
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Do you want to trigger assessment job after installation?
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Reconciliation threshold, in percentage
05:19 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data.
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: No HMS lineage collection init script exists, do you want to create one?
05:19 INFO [databricks.labs.ucx.install] Fetching installations...
05:19 INFO [databricks.labs.blueprint.parallel] finding kJpp installations 100/101, rps: 223.957/sec
05:19 INFO [databricks.labs.blueprint.parallel] finding kJpp installations 101/101, rps: 223.217/sec
05:19 INFO [databricks.labs.blueprint.parallel] Finished 'finding kJpp installations' tasks: 0% results available (0/101). Took 0:00:00.453089
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: �[1mSelect PRO or SERVERLESS SQL warehouse to run assessment dashboards on�[0m
�[1m[0]�[0m �[36m[Create new PRO SQL warehouse]�[0m
�[1m[1]�[0m �[36mDEFAULT Test Warehouse (TEST_DEFAULT_WAREHOUSE_ID, SERVERLESS, RUNNING)�[0m
Enter a number between 0 and 1
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Instance pool id to be set in cluster policy for all workflow clusters
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: We have identified one or more cluster policies set up for an external metastore. Would you like to set UCX to connect to the external metastore?
05:19 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Parallelism for migrating dbfs root delta tables with deep clone
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Min workers for auto-scale job cluster for table migration
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Max workers for auto-scale job cluster for table migration
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Open config file in the browser and continue installing? https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.kJpp/config.yml
05:19 DEBUG [tests.integration.conftest] Waiting for clusters to start...
05:19 INFO [databricks.labs.blueprint.parallel] ensure clusters running 3/3, rps: 60.775/sec
05:19 INFO [databricks.labs.blueprint.parallel] Finished 'ensure clusters running' tasks: 0% results available (0/3). Took 0:00:00.049610
05:19 DEBUG [tests.integration.conftest] Waiting for clusters to start...
05:19 INFO [databricks.labs.pytester.fixtures.baseline] Created ucx_zsb6inSw41lr8TlF catalog: https://DATABRICKS_HOST/#explore/data/ucx_zsb6inSw41lr8TlF
05:19 INFO [databricks.labs.ucx.source_code.jobs] Discovering qMUm entrypoint: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-03LV-ra78a5529b/notebook.py
05:19 INFO [databricks.labs.ucx.source_code.jobs] Linting qMUm dependency: Dependency</Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-03LV-ra78a5529b/notebook.py>
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Do you want to uninstall ucx from the workspace too, this would remove ucx project folder, dashboards, queries and jobs
05:19 INFO [databricks.labs.ucx.install] Deleting UCX v0.39.1+None20241005051905 from https://DATABRICKS_HOST
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Do you want to delete the inventory database dummy_sesav too?
05:19 INFO [databricks.labs.ucx.install] Deleting inventory database dummy_sesav
05:19 INFO [databricks.labs.lsql.deployment] Deleting hive_metastore.dummy_sesav database
05:19 INFO [databricks.labs.ucx.install] Deleting cluster policy
05:19 INFO [databricks.labs.ucx.install] Deleting secret scope
05:19 INFO [databricks.labs.ucx.install] UnInstalling UCX complete
[gw7] linux -- Python 3.10.15 /home/runner/work/ucx/ucx/.venv/bin/python

Running from nightly #218
@github-actions github-actions bot added the bug label Oct 5, 2024
@github-actions GitHub Actions
Copy link
Author

github-actions bot commented Oct 6, 2024

❌ test_job_spark_python_task_linter_unhappy_path: assert 0 == 1 (10.091s) 
assert 0 == 1
 +  where 0 = len([])
05:19 INFO [databricks.sdk] Using Databricks Metadata Service authentication
05:19 INFO [databricks.sdk] Using Databricks Metadata Service authentication
[gw9] linux -- Python 3.10.15 /home/runner/work/ucx/ucx/.venv/bin/python
05:19 INFO [databricks.sdk] Using Databricks Metadata Service authentication
05:19 INFO [databricks.sdk] Using Databricks Metadata Service authentication
05:19 INFO [databricks.labs.pytester.fixtures.notebooks] Created folder: https://DATABRICKS_HOST#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-GbRG-ra78a552ff
05:19 INFO [databricks.labs.pytester.fixtures.notebooks] Created notebook: https://DATABRICKS_HOST#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-GbRG-ra78a552ff/notebook.py
05:19 INFO [databricks.labs.pytester.fixtures.baseline] Created dummy-Dr3H: https://DATABRICKS_HOST/compute/clusters/1006-051919-63ga8v9x
05:19 INFO [databricks.labs.pytester.fixtures.notebooks] Created notebook: https://DATABRICKS_HOST#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-hXwM-ra78a552ff
05:19 INFO [databricks.labs.pytester.fixtures.baseline] Created dummy-G2Ec: https://DATABRICKS_HOST/job/959230418810257
05:19 INFO [databricks.labs.pytester.fixtures.baseline] Created hive_metastore.dummy_szibx schema: https://DATABRICKS_HOST/#explore/data/hive_metastore/dummy_szibx
05:19 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.y9iO/config.yml) doesn't exist.
05:19 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Inventory Database stored in hive_metastore
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Catalog to store UCX artifacts in
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Log level
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Number of threads
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Backup prefix
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: �[1mChoose how to map the workspace groups:�[0m
�[1m[0]�[0m �[36mMatch by Name�[0m
�[1m[1]�[0m �[36mApply a Prefix�[0m
�[1m[2]�[0m �[36mApply a Suffix�[0m
�[1m[3]�[0m �[36mMatch by External ID�[0m
�[1m[4]�[0m �[36mRegex Substitution�[0m
�[1m[5]�[0m �[36mRegex Matching�[0m
Enter a number between 0 and 5
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Enter a prefix to add to the workspace group name
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Comma-separated list of workspace group names to migrate. If not specified, we'll use all account-level groups with matching names to workspace-level groups
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Comma-separated list of databases to migrate. If not specified, we'll use all databases in hive_metastore
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Does given workspace 414838440637730 block Internet access?
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Do you want to trigger assessment job after installation?
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Reconciliation threshold, in percentage
05:19 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data.
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: No HMS lineage collection init script exists, do you want to create one?
05:19 INFO [databricks.labs.ucx.install] Fetching installations...
05:19 INFO [databricks.labs.blueprint.parallel] finding y9iO installations 100/101, rps: 239.038/sec
05:19 INFO [databricks.labs.blueprint.parallel] finding y9iO installations 101/101, rps: 240.660/sec
05:19 INFO [databricks.labs.blueprint.parallel] Finished 'finding y9iO installations' tasks: 0% results available (0/101). Took 0:00:00.420353
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: �[1mSelect PRO or SERVERLESS SQL warehouse to run assessment dashboards on�[0m
�[1m[0]�[0m �[36m[Create new PRO SQL warehouse]�[0m
�[1m[1]�[0m �[36mDEFAULT Test Warehouse (DATABRICKS_WAREHOUSE_ID, SERVERLESS, RUNNING)�[0m
Enter a number between 0 and 1
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Instance pool id to be set in cluster policy for all workflow clusters
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: We have identified one or more cluster policies set up for an external metastore. Would you like to set UCX to connect to the external metastore?
05:19 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Parallelism for migrating dbfs root delta tables with deep clone
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Min workers for auto-scale job cluster for table migration
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Max workers for auto-scale job cluster for table migration
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Open config file in the browser and continue installing? https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.y9iO/config.yml
05:19 DEBUG [tests.integration.conftest] Waiting for clusters to start...
05:19 INFO [databricks.labs.blueprint.parallel] ensure clusters running 3/3, rps: 76.480/sec
05:19 INFO [databricks.labs.blueprint.parallel] Finished 'ensure clusters running' tasks: 0% results available (0/3). Took 0:00:00.039452
05:19 DEBUG [tests.integration.conftest] Waiting for clusters to start...
05:19 INFO [databricks.labs.pytester.fixtures.baseline] Created ucx_W5b90vuYk0TZwucW catalog: https://DATABRICKS_HOST/#explore/data/ucx_W5b90vuYk0TZwucW
05:19 INFO [databricks.labs.ucx.source_code.jobs] Discovering AjL5 entrypoint: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-GbRG-ra78a552ff/notebook.py
05:19 INFO [databricks.labs.ucx.source_code.jobs] Linting AjL5 dependency: Dependency</Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-GbRG-ra78a552ff/notebook.py>
05:19 INFO [databricks.sdk] Using Databricks Metadata Service authentication
05:19 INFO [databricks.sdk] Using Databricks Metadata Service authentication
05:19 INFO [databricks.labs.pytester.fixtures.notebooks] Created folder: https://DATABRICKS_HOST#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-GbRG-ra78a552ff
05:19 INFO [databricks.labs.pytester.fixtures.notebooks] Created notebook: https://DATABRICKS_HOST#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-GbRG-ra78a552ff/notebook.py
05:19 INFO [databricks.labs.pytester.fixtures.baseline] Created dummy-Dr3H: https://DATABRICKS_HOST/compute/clusters/1006-051919-63ga8v9x
05:19 INFO [databricks.labs.pytester.fixtures.notebooks] Created notebook: https://DATABRICKS_HOST#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-hXwM-ra78a552ff
05:19 INFO [databricks.labs.pytester.fixtures.baseline] Created dummy-G2Ec: https://DATABRICKS_HOST/job/959230418810257
05:19 INFO [databricks.labs.pytester.fixtures.baseline] Created hive_metastore.dummy_szibx schema: https://DATABRICKS_HOST/#explore/data/hive_metastore/dummy_szibx
05:19 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.y9iO/config.yml) doesn't exist.
05:19 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Inventory Database stored in hive_metastore
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Catalog to store UCX artifacts in
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Log level
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Number of threads
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Backup prefix
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: �[1mChoose how to map the workspace groups:�[0m
�[1m[0]�[0m �[36mMatch by Name�[0m
�[1m[1]�[0m �[36mApply a Prefix�[0m
�[1m[2]�[0m �[36mApply a Suffix�[0m
�[1m[3]�[0m �[36mMatch by External ID�[0m
�[1m[4]�[0m �[36mRegex Substitution�[0m
�[1m[5]�[0m �[36mRegex Matching�[0m
Enter a number between 0 and 5
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Enter a prefix to add to the workspace group name
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Comma-separated list of workspace group names to migrate. If not specified, we'll use all account-level groups with matching names to workspace-level groups
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Comma-separated list of databases to migrate. If not specified, we'll use all databases in hive_metastore
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Does given workspace 414838440637730 block Internet access?
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Do you want to trigger assessment job after installation?
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Reconciliation threshold, in percentage
05:19 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data.
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: No HMS lineage collection init script exists, do you want to create one?
05:19 INFO [databricks.labs.ucx.install] Fetching installations...
05:19 INFO [databricks.labs.blueprint.parallel] finding y9iO installations 100/101, rps: 239.038/sec
05:19 INFO [databricks.labs.blueprint.parallel] finding y9iO installations 101/101, rps: 240.660/sec
05:19 INFO [databricks.labs.blueprint.parallel] Finished 'finding y9iO installations' tasks: 0% results available (0/101). Took 0:00:00.420353
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: �[1mSelect PRO or SERVERLESS SQL warehouse to run assessment dashboards on�[0m
�[1m[0]�[0m �[36m[Create new PRO SQL warehouse]�[0m
�[1m[1]�[0m �[36mDEFAULT Test Warehouse (DATABRICKS_WAREHOUSE_ID, SERVERLESS, RUNNING)�[0m
Enter a number between 0 and 1
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Instance pool id to be set in cluster policy for all workflow clusters
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: We have identified one or more cluster policies set up for an external metastore. Would you like to set UCX to connect to the external metastore?
05:19 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Parallelism for migrating dbfs root delta tables with deep clone
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Min workers for auto-scale job cluster for table migration
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Max workers for auto-scale job cluster for table migration
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Open config file in the browser and continue installing? https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.y9iO/config.yml
05:19 DEBUG [tests.integration.conftest] Waiting for clusters to start...
05:19 INFO [databricks.labs.blueprint.parallel] ensure clusters running 3/3, rps: 76.480/sec
05:19 INFO [databricks.labs.blueprint.parallel] Finished 'ensure clusters running' tasks: 0% results available (0/3). Took 0:00:00.039452
05:19 DEBUG [tests.integration.conftest] Waiting for clusters to start...
05:19 INFO [databricks.labs.pytester.fixtures.baseline] Created ucx_W5b90vuYk0TZwucW catalog: https://DATABRICKS_HOST/#explore/data/ucx_W5b90vuYk0TZwucW
05:19 INFO [databricks.labs.ucx.source_code.jobs] Discovering AjL5 entrypoint: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-GbRG-ra78a552ff/notebook.py
05:19 INFO [databricks.labs.ucx.source_code.jobs] Linting AjL5 dependency: Dependency</Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-GbRG-ra78a552ff/notebook.py>
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Do you want to uninstall ucx from the workspace too, this would remove ucx project folder, dashboards, queries and jobs
05:19 INFO [databricks.labs.ucx.install] Deleting UCX v0.39.1+None20241006051927 from https://DATABRICKS_HOST
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Do you want to delete the inventory database dummy_szibx too?
05:19 INFO [databricks.labs.ucx.install] Deleting inventory database dummy_szibx
05:19 INFO [databricks.labs.lsql.deployment] Deleting hive_metastore.dummy_szibx database
05:19 INFO [databricks.labs.ucx.install] Deleting cluster policy
05:19 INFO [databricks.labs.ucx.install] Deleting secret scope
05:19 INFO [databricks.labs.ucx.install] UnInstalling UCX complete
[gw9] linux -- Python 3.10.15 /home/runner/work/ucx/ucx/.venv/bin/python

Running from nightly #219

@github-actions GitHub Actions
Copy link
Author

github-actions bot commented Oct 7, 2024

❌ test_job_spark_python_task_linter_unhappy_path: assert 0 == 1 (12.153s) 
assert 0 == 1
 +  where 0 = len([])
[gw1] linux -- Python 3.10.15 /home/runner/work/ucx/ucx/.venv/bin/python
05:20 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.owW3/config.yml) doesn't exist.
05:20 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
05:20 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data.
05:20 INFO [databricks.labs.ucx.install] Fetching installations...
05:20 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
05:20 DEBUG [tests.integration.conftest] Waiting for clusters to start...
05:20 DEBUG [tests.integration.conftest] Waiting for clusters to start...
05:20 INFO [databricks.labs.ucx.source_code.jobs] Discovering cPUX entrypoint: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-t9e2-ra78a55363/notebook.py
05:20 INFO [databricks.labs.ucx.source_code.jobs] Linting cPUX dependency: Dependency</Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-t9e2-ra78a55363/notebook.py>
05:20 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.owW3/config.yml) doesn't exist.
05:20 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
05:20 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data.
05:20 INFO [databricks.labs.ucx.install] Fetching installations...
05:20 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
05:20 DEBUG [tests.integration.conftest] Waiting for clusters to start...
05:20 DEBUG [tests.integration.conftest] Waiting for clusters to start...
05:20 INFO [databricks.labs.ucx.source_code.jobs] Discovering cPUX entrypoint: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-t9e2-ra78a55363/notebook.py
05:20 INFO [databricks.labs.ucx.source_code.jobs] Linting cPUX dependency: Dependency</Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-t9e2-ra78a55363/notebook.py>
05:20 INFO [databricks.labs.ucx.install] Deleting UCX v0.39.1+None20241007052019 from https://DATABRICKS_HOST
05:20 INFO [databricks.labs.ucx.install] Deleting inventory database dummy_slto5
05:20 INFO [databricks.labs.ucx.install] Deleting cluster policy
05:20 INFO [databricks.labs.ucx.install] Deleting secret scope
05:20 INFO [databricks.labs.ucx.install] UnInstalling UCX complete
[gw1] linux -- Python 3.10.15 /home/runner/work/ucx/ucx/.venv/bin/python

Running from nightly #220

@JCZuurmond JCZuurmond self-assigned this Oct 7, 2024
@JCZuurmond JCZuurmond mentioned this issue Oct 7, 2024
Merged
1 task
@asnare asnare mentioned this issue Oct 7, 2024
Merged
1 task
@github-actions GitHub Actions
Copy link
Author

github-actions bot commented Oct 8, 2024

❌ test_job_spark_python_task_linter_unhappy_path: assert 0 == 1 (13.413s) 
assert 0 == 1
 +  where 0 = len([])
05:20 INFO [databricks.sdk] Using Databricks Metadata Service authentication
05:20 INFO [databricks.sdk] Using Databricks Metadata Service authentication
[gw6] linux -- Python 3.10.15 /home/runner/work/ucx/ucx/.venv/bin/python
05:20 INFO [databricks.sdk] Using Databricks Metadata Service authentication
05:20 INFO [databricks.sdk] Using Databricks Metadata Service authentication
05:20 INFO [databricks.labs.pytester.fixtures.notebooks] Created folder: https://DATABRICKS_HOST#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-uKbw-ra78a553c7
05:20 INFO [databricks.labs.pytester.fixtures.notebooks] Created notebook: https://DATABRICKS_HOST#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-uKbw-ra78a553c7/notebook.py
05:20 INFO [databricks.labs.pytester.fixtures.baseline] Created dummy-WJxm: https://DATABRICKS_HOST/compute/clusters/1008-052052-2jnv0dl3
05:20 INFO [databricks.labs.pytester.fixtures.notebooks] Created notebook: https://DATABRICKS_HOST#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-4FlG-ra78a553c7
05:20 INFO [databricks.labs.pytester.fixtures.baseline] Created dummy-JhVf: https://DATABRICKS_HOST/job/990842991099699
05:20 INFO [databricks.labs.pytester.fixtures.baseline] Created hive_metastore.dummy_srkpl schema: https://DATABRICKS_HOST/#explore/data/hive_metastore/dummy_srkpl
05:20 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.9cxj/config.yml) doesn't exist.
05:20 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
05:20 INFO [databricks.labs.blueprint.tui] Asking prompt: Inventory Database stored in hive_metastore
05:20 INFO [databricks.labs.blueprint.tui] Asking prompt: Catalog to store UCX artifacts in
05:20 INFO [databricks.labs.blueprint.tui] Asking prompt: Log level
05:20 INFO [databricks.labs.blueprint.tui] Asking prompt: Number of threads
05:20 INFO [databricks.labs.blueprint.tui] Asking prompt: Backup prefix
05:20 INFO [databricks.labs.blueprint.tui] Asking prompt: �[1mChoose how to map the workspace groups:�[0m
�[1m[0]�[0m �[36mMatch by Name�[0m
�[1m[1]�[0m �[36mApply a Prefix�[0m
�[1m[2]�[0m �[36mApply a Suffix�[0m
�[1m[3]�[0m �[36mMatch by External ID�[0m
�[1m[4]�[0m �[36mRegex Substitution�[0m
�[1m[5]�[0m �[36mRegex Matching�[0m
Enter a number between 0 and 5
05:20 INFO [databricks.labs.blueprint.tui] Asking prompt: Enter a prefix to add to the workspace group name
05:20 INFO [databricks.labs.blueprint.tui] Asking prompt: Comma-separated list of workspace group names to migrate. If not specified, we'll use all account-level groups with matching names to workspace-level groups
05:20 INFO [databricks.labs.blueprint.tui] Asking prompt: Comma-separated list of databases to migrate. If not specified, we'll use all databases in hive_metastore
05:20 INFO [databricks.labs.blueprint.tui] Asking prompt: Does given workspace 414838440637730 block Internet access?
05:20 INFO [databricks.labs.blueprint.tui] Asking prompt: Do you want to trigger assessment job after installation?
05:20 INFO [databricks.labs.blueprint.tui] Asking prompt: Reconciliation threshold, in percentage
05:20 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data.
05:20 INFO [databricks.labs.blueprint.tui] Asking prompt: No HMS lineage collection init script exists, do you want to create one?
05:20 INFO [databricks.labs.ucx.install] Fetching installations...
05:20 INFO [databricks.labs.blueprint.parallel] finding 9cxj installations 100/101, rps: 98.919/sec
05:20 INFO [databricks.labs.blueprint.parallel] finding 9cxj installations 101/101, rps: 99.078/sec
05:20 INFO [databricks.labs.blueprint.parallel] Finished 'finding 9cxj installations' tasks: 0% results available (0/101). Took 0:00:01.019930
05:20 INFO [databricks.labs.blueprint.tui] Asking prompt: �[1mSelect PRO or SERVERLESS SQL warehouse to run assessment dashboards on�[0m
�[1m[0]�[0m �[36m[Create new PRO SQL warehouse]�[0m
�[1m[1]�[0m �[36mDEFAULT Test Warehouse (TEST_DEFAULT_WAREHOUSE_ID, SERVERLESS, RUNNING)�[0m
Enter a number between 0 and 1
05:20 INFO [databricks.labs.blueprint.tui] Asking prompt: Instance pool id to be set in cluster policy for all workflow clusters
05:20 INFO [databricks.labs.blueprint.tui] Asking prompt: We have identified one or more cluster policies set up for an external metastore. Would you like to set UCX to connect to the external metastore?
05:20 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
05:20 INFO [databricks.labs.blueprint.tui] Asking prompt: Parallelism for migrating dbfs root delta tables with deep clone
05:20 INFO [databricks.labs.blueprint.tui] Asking prompt: Min workers for auto-scale job cluster for table migration
05:20 INFO [databricks.labs.blueprint.tui] Asking prompt: Max workers for auto-scale job cluster for table migration
05:20 INFO [databricks.labs.blueprint.tui] Asking prompt: Open config file in the browser and continue installing? https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.9cxj/config.yml
05:20 DEBUG [tests.integration.conftest] Waiting for clusters to start...
05:20 INFO [databricks.labs.blueprint.parallel] ensure clusters running 3/3, rps: 27.845/sec
05:20 INFO [databricks.labs.blueprint.parallel] Finished 'ensure clusters running' tasks: 0% results available (0/3). Took 0:00:00.107994
05:20 DEBUG [tests.integration.conftest] Waiting for clusters to start...
05:21 INFO [databricks.labs.pytester.fixtures.baseline] Created ucx_hCI4fqR6nB39MT1a catalog: https://DATABRICKS_HOST/#explore/data/ucx_hCI4fqR6nB39MT1a
05:21 INFO [databricks.labs.ucx.source_code.jobs] Discovering Vm2S entrypoint: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-uKbw-ra78a553c7/notebook.py
05:21 INFO [databricks.labs.ucx.source_code.jobs] Linting Vm2S dependency: Dependency</Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-uKbw-ra78a553c7/notebook.py>
05:20 INFO [databricks.sdk] Using Databricks Metadata Service authentication
05:20 INFO [databricks.sdk] Using Databricks Metadata Service authentication
05:20 INFO [databricks.labs.pytester.fixtures.notebooks] Created folder: https://DATABRICKS_HOST#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-uKbw-ra78a553c7
05:20 INFO [databricks.labs.pytester.fixtures.notebooks] Created notebook: https://DATABRICKS_HOST#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-uKbw-ra78a553c7/notebook.py
05:20 INFO [databricks.labs.pytester.fixtures.baseline] Created dummy-WJxm: https://DATABRICKS_HOST/compute/clusters/1008-052052-2jnv0dl3
05:20 INFO [databricks.labs.pytester.fixtures.notebooks] Created notebook: https://DATABRICKS_HOST#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-4FlG-ra78a553c7
05:20 INFO [databricks.labs.pytester.fixtures.baseline] Created dummy-JhVf: https://DATABRICKS_HOST/job/990842991099699
05:20 INFO [databricks.labs.pytester.fixtures.baseline] Created hive_metastore.dummy_srkpl schema: https://DATABRICKS_HOST/#explore/data/hive_metastore/dummy_srkpl
05:20 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.9cxj/config.yml) doesn't exist.
05:20 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
05:20 INFO [databricks.labs.blueprint.tui] Asking prompt: Inventory Database stored in hive_metastore
05:20 INFO [databricks.labs.blueprint.tui] Asking prompt: Catalog to store UCX artifacts in
05:20 INFO [databricks.labs.blueprint.tui] Asking prompt: Log level
05:20 INFO [databricks.labs.blueprint.tui] Asking prompt: Number of threads
05:20 INFO [databricks.labs.blueprint.tui] Asking prompt: Backup prefix
05:20 INFO [databricks.labs.blueprint.tui] Asking prompt: �[1mChoose how to map the workspace groups:�[0m
�[1m[0]�[0m �[36mMatch by Name�[0m
�[1m[1]�[0m �[36mApply a Prefix�[0m
�[1m[2]�[0m �[36mApply a Suffix�[0m
�[1m[3]�[0m �[36mMatch by External ID�[0m
�[1m[4]�[0m �[36mRegex Substitution�[0m
�[1m[5]�[0m �[36mRegex Matching�[0m
Enter a number between 0 and 5
05:20 INFO [databricks.labs.blueprint.tui] Asking prompt: Enter a prefix to add to the workspace group name
05:20 INFO [databricks.labs.blueprint.tui] Asking prompt: Comma-separated list of workspace group names to migrate. If not specified, we'll use all account-level groups with matching names to workspace-level groups
05:20 INFO [databricks.labs.blueprint.tui] Asking prompt: Comma-separated list of databases to migrate. If not specified, we'll use all databases in hive_metastore
05:20 INFO [databricks.labs.blueprint.tui] Asking prompt: Does given workspace 414838440637730 block Internet access?
05:20 INFO [databricks.labs.blueprint.tui] Asking prompt: Do you want to trigger assessment job after installation?
05:20 INFO [databricks.labs.blueprint.tui] Asking prompt: Reconciliation threshold, in percentage
05:20 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data.
05:20 INFO [databricks.labs.blueprint.tui] Asking prompt: No HMS lineage collection init script exists, do you want to create one?
05:20 INFO [databricks.labs.ucx.install] Fetching installations...
05:20 INFO [databricks.labs.blueprint.parallel] finding 9cxj installations 100/101, rps: 98.919/sec
05:20 INFO [databricks.labs.blueprint.parallel] finding 9cxj installations 101/101, rps: 99.078/sec
05:20 INFO [databricks.labs.blueprint.parallel] Finished 'finding 9cxj installations' tasks: 0% results available (0/101). Took 0:00:01.019930
05:20 INFO [databricks.labs.blueprint.tui] Asking prompt: �[1mSelect PRO or SERVERLESS SQL warehouse to run assessment dashboards on�[0m
�[1m[0]�[0m �[36m[Create new PRO SQL warehouse]�[0m
�[1m[1]�[0m �[36mDEFAULT Test Warehouse (TEST_DEFAULT_WAREHOUSE_ID, SERVERLESS, RUNNING)�[0m
Enter a number between 0 and 1
05:20 INFO [databricks.labs.blueprint.tui] Asking prompt: Instance pool id to be set in cluster policy for all workflow clusters
05:20 INFO [databricks.labs.blueprint.tui] Asking prompt: We have identified one or more cluster policies set up for an external metastore. Would you like to set UCX to connect to the external metastore?
05:20 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
05:20 INFO [databricks.labs.blueprint.tui] Asking prompt: Parallelism for migrating dbfs root delta tables with deep clone
05:20 INFO [databricks.labs.blueprint.tui] Asking prompt: Min workers for auto-scale job cluster for table migration
05:20 INFO [databricks.labs.blueprint.tui] Asking prompt: Max workers for auto-scale job cluster for table migration
05:20 INFO [databricks.labs.blueprint.tui] Asking prompt: Open config file in the browser and continue installing? https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.9cxj/config.yml
05:20 DEBUG [tests.integration.conftest] Waiting for clusters to start...
05:20 INFO [databricks.labs.blueprint.parallel] ensure clusters running 3/3, rps: 27.845/sec
05:20 INFO [databricks.labs.blueprint.parallel] Finished 'ensure clusters running' tasks: 0% results available (0/3). Took 0:00:00.107994
05:20 DEBUG [tests.integration.conftest] Waiting for clusters to start...
05:21 INFO [databricks.labs.pytester.fixtures.baseline] Created ucx_hCI4fqR6nB39MT1a catalog: https://DATABRICKS_HOST/#explore/data/ucx_hCI4fqR6nB39MT1a
05:21 INFO [databricks.labs.ucx.source_code.jobs] Discovering Vm2S entrypoint: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-uKbw-ra78a553c7/notebook.py
05:21 INFO [databricks.labs.ucx.source_code.jobs] Linting Vm2S dependency: Dependency</Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-uKbw-ra78a553c7/notebook.py>
05:21 INFO [databricks.labs.blueprint.tui] Asking prompt: Do you want to uninstall ucx from the workspace too, this would remove ucx project folder, dashboards, queries and jobs
05:21 INFO [databricks.labs.ucx.install] Deleting UCX v0.39.1+None20241008052102 from https://DATABRICKS_HOST
05:21 INFO [databricks.labs.blueprint.tui] Asking prompt: Do you want to delete the inventory database dummy_srkpl too?
05:21 INFO [databricks.labs.ucx.install] Deleting inventory database dummy_srkpl
05:21 INFO [databricks.labs.lsql.deployment] Deleting hive_metastore.dummy_srkpl database
05:21 INFO [databricks.labs.ucx.install] Deleting cluster policy
05:21 INFO [databricks.labs.ucx.install] Deleting secret scope
05:21 INFO [databricks.labs.ucx.install] UnInstalling UCX complete
[gw6] linux -- Python 3.10.15 /home/runner/work/ucx/ucx/.venv/bin/python

Running from nightly #221

@nfx nfx closed this as completed in #2852 Oct 8, 2024
@nfx nfx closed this as completed in c76d04e Oct 8, 2024
nfx pushed a commit that referenced this issue Oct 9, 2024
@asnare
Update linter integration tests to ensure notebook source is linted (#…
444d474 
…2853)

## Changes

This PR updates some linting related integration tests that weren't
testing what they expected:

- The tests were intending to verify linting of notebooks, and set up a
notebook with code to trigger a linting record.
- The linting code was failing prematurely due to the notebook
extension, not due to the problem in source.

Some usage of `greenlet` has also been replaced: it was previously
unknown to the linter and various integration tests assumed this. Since
#2830 these tests have no longer been working correctly.

### Related Issues

Overlaps with #2852.
Overlaps with #2867.
Overlaps with #2868.
Resolves #2843.
Resolves #2844.
Resolves #2845.
Resolves #2846.

### Tests

- [X] updated integration tests
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@JCZuurmond JCZuurmond

Labels
None yet
Projects
None yet
Milestone
No milestone
1 participant
@JCZuurmond