infra: OUR_LLVM_REVISION=llvmorg-18-init-14420-gea3a3b25

[maflcko]

Basically #8108 with small fixups, to properly set CC and CXX and -S for the libc++ i386 and msan builds

[maflcko]

Ah, I guess CI is expected to fail.

Can someone please initiate a gcbrun trial build?

[maflcko]

I checked locally that the build completes for some random projects, via:

infra/base-images/all.sh
python3 infra/helper.py build_fuzzers --sanitizer undefined  --engine libfuzzer tokio
python3 infra/helper.py build_fuzzers --sanitizer address    --engine afl curl
python3 infra/helper.py build_fuzzers --sanitizer address  --engine libfuzzer --architecture i386 curl
python3 infra/helper.py build_fuzzers --sanitizer memory  --engine libfuzzer curl

[maflcko]

cc @jonathanmetzman @DavidKorczynski

[DavidKorczynski]

Thanks @maflcko

Do you know the details of the error that occurs?:

2024-03-19T11:16:30.8624867Z #5 14.52   adding 'pyinstaller-5.0.1.dist-info/RECORD'
2024-03-19T11:16:30.8625058Z #5 14.52   removing build/bdist.linux-x86_64/wheel
2024-03-19T11:16:30.8625453Z #5 14.52   No precompiled bootloader found or compile forced. Trying to compile the bootloader for you ...
2024-03-19T11:16:30.8625818Z #5 14.52 ERROR: Could not build wheels for atheris which use PEP 517 and cannot be installed directly
2024-03-19T11:16:30.8626120Z #5 14.52 WARNING: You are using pip version 19.2.3, however version 24.0 is available.
2024-03-19T11:16:30.8626473Z #5 14.52 You should consider upgrading via the 'pip install --upgrade pip' command.
2024-03-19T11:16:30.8626867Z #5 ERROR: process "/bin/sh -c install_python.sh" did not complete successfully: exit code: 1
2024-03-19T11:16:30.8626967Z ------
2024-03-19T11:16:30.8627081Z  > [2/2] RUN install_python.sh:
2024-03-19T11:16:30.8627306Z 14.52   adding 'pyinstaller-5.0.1.dist-info/METADATA'
2024-03-19T11:16:30.8627504Z 14.52   adding 'pyinstaller-5.0.1.dist-info/WHEEL'
2024-03-19T11:16:30.8627755Z 14.52   adding 'pyinstaller-5.0.1.dist-info/entry_points.txt'
2024-03-19T11:16:30.8627982Z 14.52   adding 'pyinstaller-5.0.1.dist-info/top_level.txt'
2024-03-19T11:16:30.8628250Z 14.52   adding 'pyinstaller-5.0.1.dist-info/RECORD'
2024-03-19T11:16:30.8628436Z 14.52   removing build/bdist.linux-x86_64/wheel
2024-03-19T11:16:30.8628818Z 14.52   No precompiled bootloader found or compile forced. Trying to compile the bootloader for you ...
2024-03-19T11:16:30.8629179Z 14.52 ERROR: Could not build wheels for atheris which use PEP 517 and cannot be installed directly
2024-03-19T11:16:30.8629462Z 14.52 WARNING: You are using pip version 19.2.3, however version 24.0 is available.
2024-03-19T11:16:30.8629812Z 14.52 You should consider upgrading via the 'pip install --upgrade pip' command.
2024-03-19T11:16:30.8629909Z ------
2024-03-19T11:16:30.8629999Z Dockerfile:19
2024-03-19T11:16:30.8630113Z --------------------
2024-03-19T11:16:30.8630362Z   17 |     FROM gcr.io/oss-fuzz-base/base-builder
2024-03-19T11:16:30.8630456Z   18 |     
2024-03-19T11:16:30.8630570Z   19 | >>> RUN install_python.sh
2024-03-19T11:16:30.8630658Z   20 |     
2024-03-19T11:16:30.8630770Z --------------------
2024-03-19T11:16:30.8631230Z ERROR: failed to solve: process "/bin/sh -c install_python.sh" did not complete successfully: exit code: 1
2024-03-19T11:16:30.8631351Z ERROR:__main__:Docker build failed.
2024-03-19T11:16:30.8631490Z Pulling and building base images first.

[maflcko]

Yes, the error only happens in the CI, because it pulls the old base-clang image (as opposed to building the current one). See https://github.com/google/oss-fuzz/actions/runs/8341860860/job/22828806330?pr=11707#step:7:1563 . Thus, the libclang_rt.fuzzer.a will not be present, when the environment variable is set before install_python.sh. See https://github.com/google/oss-fuzz/actions/runs/8341860860/job/22828806330?pr=11707#step:7:19279 and https://github.com/google/oss-fuzz/actions/runs/8341860860/job/22828806330?pr=11707#step:7:27017

Not building the base-clang is done, because I don't think there are enough resources in GitHub Actions to compile clang?

If you run locally, it should pass.

[DavidKorczynski]

/gcbrun trial_build.py all --fuzzing-engines libfuzzer --sanitizers coverage address

[maflcko]

The error is that my branch name is not a valid docker tag:

Step #1: Step #0: invalid argument "gcr.io/oss-fuzz-base/base-image-testing-2403-roll-clang-" for "-t, --tag" flag: invalid reference format

[maflcko]

Renamed branch to #11714