Connector Issue: cannot compile :airbyte-integrations:bases:base-java:airbyteDocker

[ggam]

Connector Name

source-oracle

Connector Version

master

What step the error happened?

Other

Revelant information

I'm trying to work on #20924 and other Oracle source mapping stuff. Following instructions on https://github.com/airbytehq/airbyte/tree/master/airbyte-integrations/connectors/source-oracle I execute ./gradlew :airbyte-integrations:connectors:source-oracle:build but it fails on :airbyte-integrations:bases:base-java:airbyteDocker.

My system is Fedora 38, with Temurin 17 as Java runtime.

Relevant log output

[guillermo@guillermo proyectos]$ git clone https://github.com/airbytehq/airbyte.git
Cloning into 'airbyte'...
remote: Enumerating objects: 1707732, done.
remote: Counting objects: 100% (10284/10284), done.
remote: Compressing objects: 100% (678/678), done.
remote: Total 1707732 (delta 5353), reused 10006 (delta 5137), pack-reused 1697448
Receiving objects: 100% (1707732/1707732), 2.43 GiB | 10.06 MiB/s, done.
Resolving deltas: 100% (927519/927519), done.
Updating files: 100% (14790/14790), done.
[guillermo@guillermo proyectos]$ cd airbyte/
[guillermo@guillermo airbyte]$ ./gradlew :airbyte-integrations:connectors:source-oracle:build
Starting a Gradle Daemon, 2 stopped Daemons could not be reused, use --status for details
Building all of Airbyte.
/home/guillermo/proyectos/airbyte/airbyte-integrations/connectors

> Task :airbyte-api:generateApiClient
################################################################################
# Thanks for using OpenAPI Generator.                                          #
# Please consider donation to help us maintain this project 🙏                 #
# https://opencollective.com/openapi_generator/donate                          #
################################################################################
Successfully generated code to /home/guillermo/proyectos/airbyte/airbyte-api/build/generated/api/client

> Task :airbyte-api:generateApiDocs
################################################################################
# Thanks for using OpenAPI Generator.                                          #
# Please consider donation to help us maintain this project 🙏                 #
# https://opencollective.com/openapi_generator/donate                          #
################################################################################
Successfully generated code to /home/guillermo/proyectos/airbyte/airbyte-api/build/generated/api/docs

> Task :airbyte-api:generateApiServer
################################################################################
# Thanks for using OpenAPI Generator.                                          #
# Please consider donation to help us maintain this project 🙏                 #
# https://opencollective.com/openapi_generator/donate                          #
################################################################################
Successfully generated code to /home/guillermo/proyectos/airbyte/airbyte-api/build/generated/api/server

> Task :airbyte-commons:compileJava
Note: /home/guillermo/proyectos/airbyte/airbyte-commons/src/main/java/io/airbyte/commons/json/Jsons.java uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: /home/guillermo/proyectos/airbyte/airbyte-commons/src/main/java/io/airbyte/commons/util/MoreIterators.java uses unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.

> Task :airbyte-api:generateApiServerLegacy
################################################################################
# Thanks for using OpenAPI Generator.                                          #
# Please consider donation to help us maintain this project 🙏                 #
# https://opencollective.com/openapi_generator/donate                          #
################################################################################
Successfully generated code to /home/guillermo/proyectos/airbyte/airbyte-api/build/generated/api/server

> Task :airbyte-integrations:bases:base:airbyteDocker
#1 [internal] load build definition from Dockerfile
#1 sha256:5b5a94429312169abf8f1b9d39b44c5f4971821ae339b3e80a2fba207d691838
#1 transferring dockerfile: 327B done
#1 DONE 0.3s

#2 [internal] load .dockerignore
#2 sha256:dadce1a7cee49e46d705ffae9c01612811231807ce76f0d04bb2b5ae66ebfeeb
#2 transferring context: 105B done
#2 DONE 0.2s

#3 [internal] load metadata for docker.io/library/amazonlinux:2022.0.20220831.1
#3 sha256:58cd828510bffe8a1238c63efae7efd647789269a2cd1103cecebedc4402451f
#3 DONE 1.1s

#6 [1/3] FROM docker.io/library/amazonlinux:2022.0.20220831.1@sha256:d26e31b5b4bb811a12cb868453a980a9ae53338020130521b67068cec9cabcc8
#6 sha256:e7cc237cbe1a097943dd4310dc74f522449096e4efc7bf095adfcf6237839a10
#6 DONE 0.0s

#7 [internal] load build context
#7 sha256:613bd9f3048feb0dea469721175ffe831907a80492ed97eedd5bac5d1b02215a
#7 transferring context: 1.30kB done
#7 DONE 0.1s

#4 [2/3] WORKDIR /airbyte
#4 sha256:b4d52bcd8feecd1da58e793baaeba8f6fee99a1c9d99c24f8d23d4ed314e06e4
#4 CACHED

#5 [3/3] COPY base.sh .
#5 sha256:08911ab247c3a780a10bf696e0624f6e90c55a5a90694fd7dcd7b629bf44c1f4
#5 CACHED

#8 exporting to image
#8 sha256:e8c613e07b0b7ff33893b694f7759a10d42e180f2b4dc349fb57dc6b71dcab00
#8 exporting layers done
#8 writing image sha256:1392d7d2c7b7b8fab3c03a892c0319d9bdffce478d951508c7ec058a9381b4df done
#8 naming to docker.io/airbyte/integration-base:dev done
#8 DONE 0.0s

> Task :airbyte-commons-protocol:compileJava
SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
SLF4J: Defaulting to no-operation (NOP) logger implementation
SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.

SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
SLF4J: Defaulting to no-operation (NOP) logger implementation
SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.

> Task :airbyte-commons-protocol:compileJava
Note: Creating bean classes for 8 type elements
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.

> Task :airbyte-config-oss:config-models-oss:compileJava
Note: Creating bean classes for 18 type elements
Note: /home/guillermo/proyectos/airbyte/airbyte-config-oss/config-models-oss/src/main/java/io/airbyte/configoss/ConfigSchema.java uses unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.

> Task :airbyte-api:compileJava
Note: /home/guillermo/proyectos/airbyte/airbyte-api/build/generated/api/client/src/main/java/io/airbyte/api/client/invoker/generated/JSON.java uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.

> Task :airbyte-integrations:bases:base-java:compileJava
Note: /home/guillermo/proyectos/airbyte/airbyte-integrations/bases/base-java/src/main/java/io/airbyte/integrations/destination/StandardNameTransformer.java uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: /home/guillermo/proyectos/airbyte/airbyte-integrations/bases/base-java/src/main/java/io/airbyte/integrations/base/ssh/SshBastionContainer.java uses unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.

> Task :airbyte-db:db-lib:compileJava
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.

> Task :airbyte-integrations:bases:base-java:airbyteDocker
#1 [internal] load build definition from Dockerfile
#1 sha256:e7081e1f64b29542becf687f168e00897b742f76fec923e4ab4348f0296ac2a7
#1 transferring dockerfile: 850B done
#1 DONE 0.1s

#2 [internal] load .dockerignore
#2 sha256:78b9347010fa9ed35b43a8957829fdf5fc9580d4ce98c609ef680b9f1cb910f5
#2 transferring context: 133B done
#2 DONE 0.1s

#3 [internal] load metadata for docker.io/library/amazoncorretto:17.0.4
#3 sha256:26e6cae1168cfa7006d21f8c6d2ed9aa8a3f72aab11e427ece37874b602245ee
#3 DONE 2.4s

#5 FROM docker.io/airbyte/integration-base:dev
#5 sha256:ea1d2982e36f625c04af55704056faf3a4bafcb524f7ced72ddf07b677d0cb11
#5 DONE 0.0s

#4 [stage-0 1/6] FROM docker.io/library/amazoncorretto:17.0.4@sha256:4c5b6c73aaa0b39c8be05e7b444c13db55bfe88b6044a2854f3e2f5f03df6fb1
#4 sha256:b56859972f11c6f5b91800e3e92b53c9c2a7b56476006afcebec3f3e666c3c67
#4 DONE 0.0s

#6 [stage-0 2/6] COPY --from=airbyte/integration-base:dev /airbyte /airbyte
#6 sha256:34f372f2a09843efa82f35444569d32328262445b34dcb31b0460c9838295678
#6 CACHED

#11 [internal] load build context
#11 sha256:55d41ff23855e351c8c27ce01e72096990b1f285736ca2b2ce37bf456a99e0f9
#11 transferring context: 1.16kB done
#11 DONE 0.0s

#7 [stage-0 3/6] RUN yum install -y tar openssl && yum clean all
#7 sha256:e47cd19babc8171f8fcc65dc0137f2b22d8eb14c6071888f8edc4d9c6e6c8c2f
#7 0.528 exec /bin/sh: permission denied
#7 ERROR: executor failed running [/bin/sh -c yum install -y tar openssl && yum clean all]: exit code: 1

#9 https://dtdg.co/latest-java-tracer
#9 sha256:efbe52742842e63910b36959ace0ed819eba2218d490430f5de02a8a07b28b5d
#9 CANCELED
------
 > [stage-0 3/6] RUN yum install -y tar openssl && yum clean all:
------
executor failed running [/bin/sh -c yum install -y tar openssl && yum clean all]: exit code: 1

> Task :airbyte-integrations:bases:base-java:airbyteDocker FAILED
SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
SLF4J: Defaulting to no-operation (NOP) logger implementation
SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':airbyte-integrations:bases:base-java:airbyteDocker'.
> Process 'command '/home/guillermo/proyectos/airbyte/tools/bin/build_image.sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.6/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 2m 51s
45 actionable tasks: 45 executed
S3 cache 3s wasted on misses, reads: 18, elapsed: 5s
[guillermo@guillermo airbyte]$

Contribute

• Yes, I want to contribute

[ggam]

Interestingly, I'm able to manually build the offending Docker image via: cd airbyte-integrations/bases/base-java && docker build -t test .

[marcosmarxm]

@ggam I was able to run ./gradlew :airbyte-integrations:connectors:source-oracle:build using latest version of master branch.

#7 ERROR: executor failed running [/bin/sh -c yum install -y tar openssl && yum clean all]: exit code: 1

Not sure if this error maybe is related to Fedora OS not been able to build the docker container.

[ggam]

It was definitely somehting on my system, probably related to some incomplete non-root Docker configuration. I reinstalled Docker and it worked correctly.

Sorry for the noise and thanks for the fast response!