Skip to content

Commit

Permalink
fix(ci): tweak heavy fuzz run parameters (ethereum-optimism#11894)
Browse files Browse the repository at this point in the history
Tweaks various parameters for the heavy fuzz run tests to prevent
the test from taking too long. We can run a daily super heavy fuzz
run instead to catch any rare flakes.
  • Loading branch information
smartcontracts authored and samlaf committed Nov 10, 2024
1 parent e63b214 commit a41fec6
Show file tree
Hide file tree
Showing 2 changed files with 9 additions and 4 deletions.
7 changes: 6 additions & 1 deletion .circleci/config.yml
Original file line number Diff line number Diff line change
Expand Up @@ -559,6 +559,10 @@ jobs:
test_command:
description: List of test files to run
type: string
test_timeout:
description: Timeout for running tests
type: string
default: 15m
parallelism: <<parameters.test_parallelism>>
steps:
- checkout
Expand Down Expand Up @@ -596,7 +600,7 @@ jobs:
environment:
FOUNDRY_PROFILE: ci
working_directory: packages/contracts-bedrock
no_output_timeout: 15m
no_output_timeout: <<parameters.test_timeout>>
- run:
name: print failed test traces
command: just test-rerun
Expand Down Expand Up @@ -1579,6 +1583,7 @@ workflows:
# Heavily fuzz any fuzz tests that have been added or modified.
name: contracts-bedrock-tests-heavy-fuzz-modified
test_parallelism: 1
test_timeout: 1h
test_command: just test-heavy-fuzz-modified-tests
- contracts-bedrock-coverage
- contracts-bedrock-checks:
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -12,10 +12,10 @@ set -euo pipefail
# modified.

# Set the number of fuzz runs to run.
# 350000 fuzz runs will guarantee that any test that fails 1% of the time with
# the default 512 fuzz runs will fail 99.9% of the time (on average) inside of
# 75000 fuzz runs will guarantee that any test that fails 5% of the time with
# the default 512 fuzz runs will fail >99.9% of the time (on average) inside of
# this script.
FUZZ_RUNS=${1:-350000}
FUZZ_RUNS=${1:-75000}

# Set the number of invariant runs to run.
# Invariant runs are generally slower than fuzz runs so we can't afford to run
Expand Down

0 comments on commit a41fec6

Please sign in to comment.