Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create Databricks access connector #1376

Closed

Conversation

JCZuurmond
Copy link
Member

@JCZuurmond JCZuurmond commented Apr 12, 2024

Changes

  • Create access connector-managed identity

Linked issues

Resolves #888

Functionality

  • added relevant user documentation
  • added new CLI command
  • modified existing command: databricks labs ucx ...
  • added a new workflow
  • modified existing workflow: ...
  • added a new table
  • modified existing table: ...

Tests

  • manually tested
  • added unit tests
  • added integration tests
  • verified on staging environment (screenshot attached)

Copy link
Collaborator

@nfx nfx left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You have to create a user managed identity first

@nfx
Copy link
Collaborator

nfx commented Apr 12, 2024

@JCZuurmond JCZuurmond force-pushed the feature/handle-access-connector-managed-identity branch from 52592b5 to 420d6eb Compare April 12, 2024 09:38
@JCZuurmond JCZuurmond requested a review from qziyuan April 15, 2024 18:27
Copy link
Member Author

@JCZuurmond JCZuurmond left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Will be split into smaller PR, see comment

@@ -21,16 +24,23 @@
@dataclass
class StoragePermissionMapping:
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@nfx : The change to this data class blew up the PR.

  1. I will separate the PR to make it easier to comprehend and review.
  2. I would like your input on if we can circumvent this change. Specifically the role_name, which is required to track the storage permission, so that we can set the appropriate permission level for the access connectors. The StoragePermissionMapping contains the Databricks privilege, however, this does not map to the Azure storage permissions. -> We could neglect the "Storage Blob Data Owner", give "Storage Blob Data Contributor" as highest permission as the access connectors should not be used to do POSIX access control

@JCZuurmond
Copy link
Member Author

First merge: #1417

@JCZuurmond JCZuurmond closed this Apr 16, 2024
@nfx nfx deleted the feature/handle-access-connector-managed-identity branch April 26, 2024 15:25
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[FEATURE]: Create access connector with managed identity
2 participants