Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Load CDK: Drop vestigial obj storage staging stuff #54661

Merged
merged 1 commit into from
Feb 25, 2025

Conversation

johnny-schmidt
Copy link
Contributor

What

NON-FUNCTIONAL CODE CLEANUP

This drops the remaining references to staging in the object storage toolkit. (Staging was an abortive attempt at fixing the issues with metadata search as part of the S3V2 release. We disabled it, and subsequent changes have rendered the existing code moot, so it's better to drop it than to give the false impression that it is useful.)

Why

In addition to cleanup

  • we are approaching the point where object storage is used by more than one use case
  • i'm about to rewrite s3 for the files speed test

So I'm going to clean up / simplify the configuration a little bit so that not everybody is burdened by S3's insane legacy path rules.

@johnny-schmidt johnny-schmidt requested a review from a team as a code owner February 24, 2025 22:42
Copy link

vercel bot commented Feb 24, 2025

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
airbyte-docs ✅ Ready (Inspect) Visit Preview 💬 Add feedback Feb 25, 2025 10:09pm

Copy link
Contributor

@edgao edgao left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🔪

@johnny-schmidt johnny-schmidt force-pushed the jschmidt/load-cdk/generic-path-factory branch from 2a663ea to 34a8bb7 Compare February 25, 2025 21:56
@johnny-schmidt johnny-schmidt force-pushed the jschmidt/load-cdk/generic-path-factory branch from 34a8bb7 to 68fcb88 Compare February 25, 2025 21:57
@johnny-schmidt johnny-schmidt enabled auto-merge (squash) February 25, 2025 21:57
@octavia-squidington-iii octavia-squidington-iii added the area/documentation Improvements or additions to documentation label Feb 25, 2025
@johnny-schmidt johnny-schmidt merged commit 6196fb7 into master Feb 25, 2025
29 checks passed
@johnny-schmidt johnny-schmidt deleted the jschmidt/load-cdk/generic-path-factory branch February 25, 2025 22:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/connectors Connector related issues area/documentation Improvements or additions to documentation CDK Connector Development Kit connectors/destination/s3
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants