embedded mongo is downloading ubuntu binary on amazon linux 2

[fnaeem78]

Is there a way to download a particular os version binary, by specifying it in test properties. In my case it seems to be downloading ubuntu on Amazon linux 2(yum based) system and then is running into errors. This is the relevant stack trace.

2023-07-12 21:22:43,203 WARN  [main] d.f.e.m.p.l.LinuxPackageFinder$FallbackToUbuntuOrFailPackageFinder: because there is no package for GenericFeatureAwareVersion{6.0.5}:Platform{operatingSystem=Linux, architecture=X86_64} we fall back to GenericFeatureAwareVersion{6.0.5}:Platform{operatingSystem=Linux, architecture=X86_64, version=Ubuntu_20_04}
2023-07-12 21:22:43,791 INFO  [main] d.f.e.p.i.Slf4jLevel$3: download https://fastdl.mongodb.org/linux/mongodb-linux-x86_64-ubuntu2004-6.0.5.tgz : starting...
2023-07-12 21:22:43,792 INFO  [main] d.f.e.p.i.Slf4jLevel$3: download https://fastdl.mongodb.org/linux/mongodb-linux-x86_64-ubuntu2004-6.0.5.tgz : 0 %
2023-07-12 21:22:44,184 INFO  [main] d.f.e.p.i.Slf4jLevel$3: download https://fastdl.mongodb.org/linux/mongodb-linux-x86_64-ubuntu2004-6.0.5.tgz : 10 %
2023-07-12 21:22:44,356 INFO  [main] d.f.e.p.i.Slf4jLevel$3: download https://fastdl.mongodb.org/linux/mongodb-linux-x86_64-ubuntu2004-6.0.5.tgz : 20 %
2023-07-12 21:22:44,446 INFO  [main] d.f.e.p.i.Slf4jLevel$3: download https://fastdl.mongodb.org/linux/mongodb-linux-x86_64-ubuntu2004-6.0.5.tgz : 30 %
2023-07-12 21:22:44,536 INFO  [main] d.f.e.p.i.Slf4jLevel$3: download https://fastdl.mongodb.org/linux/mongodb-linux-x86_64-ubuntu2004-6.0.5.tgz : 40 %
2023-07-12 21:22:44,671 INFO  [main] d.f.e.p.i.Slf4jLevel$3: download https://fastdl.mongodb.org/linux/mongodb-linux-x86_64-ubuntu2004-6.0.5.tgz : 50 %
2023-07-12 21:22:44,783 INFO  [main] d.f.e.p.i.Slf4jLevel$3: download https://fastdl.mongodb.org/linux/mongodb-linux-x86_64-ubuntu2004-6.0.5.tgz : 60 %
2023-07-12 21:22:44,895 INFO  [main] d.f.e.p.i.Slf4jLevel$3: download https://fastdl.mongodb.org/linux/mongodb-linux-x86_64-ubuntu2004-6.0.5.tgz : 70 %
2023-07-12 21:22:45,021 INFO  [main] d.f.e.p.i.Slf4jLevel$3: download https://fastdl.mongodb.org/linux/mongodb-linux-x86_64-ubuntu2004-6.0.5.tgz : 80 %
2023-07-12 21:22:45,140 INFO  [main] d.f.e.p.i.Slf4jLevel$3: download https://fastdl.mongodb.org/linux/mongodb-linux-x86_64-ubuntu2004-6.0.5.tgz : 90 %
2023-07-12 21:22:45,245 INFO  [main] d.f.e.p.i.Slf4jLevel$3: download https://fastdl.mongodb.org/linux/mongodb-linux-x86_64-ubuntu2004-6.0.5.tgz : finished
2023-07-12 21:22:46,323 ERROR [Thread-4] d.f.e.p.i.Slf4jLevel$5: /home/build/.embedmongo/fileSets/4e26668721df0327a3131a1fbe19ad25a747e9240025cb2bc4e833720b48d65e/mongod: error while loading shared libraries: libcrypto.so.1.1: cannot open shared object file: No such file or directory

[michaelmosmann]

@fnaeem78 hmm.. so amazon-linux2 is not detected.. you can override it this way: https://github.com/flapdoodle-oss/de.flapdoodle.os#run .. but can you provide some more information about this host (hostname, content of /etc/os-release)?

[fnaeem78]

NAME="Amazon Linux"
VERSION="2"
ID="amzn"
ID_LIKE="centos rhel fedora"
VERSION_ID="2"
PRETTY_NAME="Amazon Linux 2"
ANSI_COLOR="0;33"
CPE_NAME="cpe:2.3:o:amazon:amazon_linux:2"
HOME_URL="https://amazonlinux.com/"

This is /etc/os-release.
/etc/hostname is nothing but the commit hash of the docker container.

The Platform object when printed is showing this :
Platform{operatingSystem=Linux, architecture=X86_64}
and I believe that maybe the source of the issue.

[fnaeem78]

@michaelmosmann does this look right. I put this in my test class and it still failed to detect.
"de.flapdoodle.os.override=Linux|X86_64|amzn2"

the last bit I added to force it to detect amazon, based upon one of the regex that I found in the code of the os package. but to no avail, it is still falling back to ubuntu.

I saw a comment, (#89 (comment)) by you which suggested putting in a tgz file in the linux directory. under .embedmongo. I did that for my build user mongo 6.08 for amzn2 , also created an archives directory. All of them owned by the build user, it still gave me the same error of falling back to Ubuntu.

Tried it both with and without the override, same result.

[michaelmosmann]

@fnaeem78 You should try:

de.flapdoodle.os.override=Linux|X86_64|Amazon|AmazonLinux2

.. and this must be a system property. So run your build with that... for instance:

mvn -Dde.flapdoodle.os.override=Linux|X86_64|Amazon|AmazonLinux2 test

The comment is for a very old version of this software.. and does lead to the wrong direction. The current problem: the os detection does not guess the right os.. so it uses the wrong distribution. The comment is related to the situation where the download failed, so that a manual download could fix that, if you put it to the location where the downloads are cached.

[michaelmosmann]

@fnaeem78 .. i think with your information i can enhance the amazon dist detection... i guess i can make a new release at the weekend.

[fnaeem78]

thankyou, that worked. please tag me when you merge your PR so I can grab the latest binary.

[michaelmosmann]

@fnaeem78 did a new release of de.flapdoodle.embedded.mongo to 4.7.1.. it should now detect your amazon2 and in any case provide a more detailed error message if something fails.. will be in maven central in 12 to 24 hrs.

[michaelmosmann]

.. i close this, reopen if needed.