chore: Improve temporary stopgap implemented in 4014 #2346

Job	Run time
build-acvm-js	4m 42s
build-nargo	2m 23s
build-noirc-abi	4m 15s
noirc_abi	45s
noir-js-backend-barretenberg	56s
build-noir-wasm	2m 35s
ACVM JS (Node.js)	38s
ACVM JS (Browser)	1m 37s
Noir JS	1m 30s
noir_codegen	1m 0s
Integration Tests	10m 18s
noir_wasm	1m 19s
End	1s
	31m 59s

Provide feedback