Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

ci: Add test case for hdfs over gcs bucket #3504

Closed
Xuanwo opened this issue Nov 7, 2023 · 2 comments
Closed

ci: Add test case for hdfs over gcs bucket #3504

Xuanwo opened this issue Nov 7, 2023 · 2 comments
Assignees
@ArmandoZ

Comments

@Xuanwo
Copy link
Member

Xuanwo commented Nov 7, 2023 •
edited
Loading

gcs bucket provide Google Cloud Storage Connector support. We can add this as a test case for hdfs to make sure we work as expected.

Maybe also for aws s3 and azblob?

INSTALL: https://github.com/GoogleCloudDataproc/hadoop-connectors/blob/master/gcs/INSTALL.md
CONFIGURATION: https://github.com/GoogleCloudDataproc/hadoop-connectors/blob/master/gcs/CONFIGURATION.md
@ArmandoZ
Copy link
Contributor

Can I have a try? I can start with adding test case for hdfs-gcs and then maybe also for aws s3 (using S3A) and azblob (using hadoop-azure module)

@Xuanwo
Copy link
Member Author

Xuanwo commented Jan 30, 2024

Can I have a try?

Welcome!

ArmandoZ added a commit to ArmandoZ/opendal that referenced this issue Feb 5, 2024
@ArmandoZ
ci: Add test case for hdfs over gcs bucket (apache#3504)
6a81742
@ArmandoZ ArmandoZ mentioned this issue Feb 5, 2024
Merged
ArmandoZ added a commit to ArmandoZ/opendal that referenced this issue Feb 5, 2024
@ArmandoZ
ci: Add test case for hdfs over gcs bucket (apache#3504)
c9491a9
ArmandoZ added a commit to ArmandoZ/opendal that referenced this issue Feb 5, 2024
@ArmandoZ
ci: Add test case for hdfs over gcs bucket (apache#3504)
9c1e273
ArmandoZ added a commit to ArmandoZ/opendal that referenced this issue Feb 5, 2024
@ArmandoZ
ci: Add test case for hdfs over gcs bucket (apache#3504)
4240700
ArmandoZ added a commit to ArmandoZ/opendal that referenced this issue Feb 6, 2024
@ArmandoZ
ci: Add test case for hdfs over gcs bucket (apache#3504)
7911458
ArmandoZ added a commit to ArmandoZ/opendal that referenced this issue Feb 7, 2024
@ArmandoZ
ci: Add test case for hdfs over gcs bucket (apache#3504)
8dcb19d
Xuanwo pushed a commit that referenced this issue Feb 7, 2024
@ArmandoZ
ci: Add test case for hdfs over gcs bucket (#4145)
a64e9a5 
* ci: Add test case for hdfs over gcs bucket (#3504)

* Update xml headers

* Modify CLASSPATH
@Xuanwo Xuanwo closed this as completed Feb 7, 2024
@Xuanwo Xuanwo mentioned this issue Feb 7, 2024
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@ArmandoZ ArmandoZ

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@Xuanwo @ArmandoZ