Cherry pick 3ab2c1761ebdbb2a7e2e8c8ff0a24e813289f70f into aptos-release-v1.9

[banool]

Internal context: https://aptos-org.slack.com/archives/C041CLG018F/p1705420540475269.

[trunk-io]

⏱️ 3h 40m total CI duration on this PR

Job	Cumulative Duration	Recent Runs
rust-unit-tests	36m	🟩
rust-smoke-tests	33m	🟩
forge-framework-upgrade-test / forge	30m	🟥
windows-build	26m	🟩
execution-performance / single-node-performance	21m	🟩
forge-compat-test / forge	14m	🟩
forge-e2e-test / forge	13m	🟩
rust-images / rust-all	12m	🟩
rust-lints	12m	🟩
cli-e2e-tests / run-cli-tests	7m	🟩
run-tests-main-branch	5m	⬜ 🟩
check	4m	🟥
general-lints	2m	🟩
check-dynamic-deps	2m	🟩
node-api-compatibility-tests / node-api-compatibility-tests	51s	🟩
file_change_determinator	20s	🟩 🟩
semgrep/ci	19s	🟩
file_change_determinator	12s	🟩
execution-performance / file_change_determinator	11s	🟩
file_change_determinator	9s	🟩
permission-check	9s	🟩 🟩
execution-performance / sequential-execution-performance	8s	🟩
execution-performance / parallel-execution-performance	8s	🟩
permission-check	7s	🟩 🟩
permission-check	7s	🟩 🟩
permission-check	4s	🟩 🟩
permission-check	3s	🟩
determine-docker-build-metadata	1s	🟩

🚨 2 jobs on the last run were significantly faster/slower than expected

Job	Duration	vs 7d avg	Delta
rust-lints	12m	8m
windows-build	26m	19m

_{settings ⋅ feedback ⋅ docs ⋅ learn more about trunk.io}

[github-actions]

✅ Forge suite realistic_env_max_load success on 46a4788be7c991113f0bdc312ba84723799bfd66

two traffics test: inner traffic : committed: 7258 txn/s, latency: 5302 ms, (p50: 5000 ms, p90: 6600 ms, p99: 11400 ms), latency samples: 3164920
two traffics test : committed: 100 txn/s, latency: 2297 ms, (p50: 2200 ms, p90: 2700 ms, p99: 3800 ms), latency samples: 1780
Latency breakdown for phase 0: ["QsBatchToPos: max: 0.213, avg: 0.197", "QsPosToProposal: max: 0.155, avg: 0.150", "ConsensusProposalToOrdered: max: 0.587, avg: 0.576", "ConsensusOrderedToCommit: max: 0.498, avg: 0.482", "ConsensusProposalToCommit: max: 1.080, avg: 1.058"]
Max round gap was 1 [limit 4] at version 1501408. Max no progress secs was 4.123286 [limit 10] at version 1501408.
Test Ok

• Grafana dashboard
• Humio Logs
• Axiom Logs
• Test runner output
• Test run is land-blocking

[github-actions]

✅ Forge suite compat success on aptos-node-v1.8.3 ==> 46a4788be7c991113f0bdc312ba84723799bfd66

Compatibility test results for aptos-node-v1.8.3 ==> 46a4788be7c991113f0bdc312ba84723799bfd66 (PR)
1. Check liveness of validators at old version: aptos-node-v1.8.3
compatibility::simple-validator-upgrade::liveness-check : committed: 4871 txn/s, latency: 6487 ms, (p50: 6500 ms, p90: 9300 ms, p99: 12100 ms), latency samples: 185100
2. Upgrading first Validator to new version: 46a4788be7c991113f0bdc312ba84723799bfd66
compatibility::simple-validator-upgrade::single-validator-upgrade : committed: 1776 txn/s, latency: 16282 ms, (p50: 19000 ms, p90: 22300 ms, p99: 22600 ms), latency samples: 92400
3. Upgrading rest of first batch to new version: 46a4788be7c991113f0bdc312ba84723799bfd66
compatibility::simple-validator-upgrade::half-validator-upgrade : committed: 1397 txn/s, latency: 20266 ms, (p50: 21700 ms, p90: 31700 ms, p99: 32600 ms), latency samples: 68500
4. upgrading second batch to new version: 46a4788be7c991113f0bdc312ba84723799bfd66
compatibility::simple-validator-upgrade::rest-validator-upgrade : committed: 2796 txn/s, latency: 8877 ms, (p50: 9900 ms, p90: 12400 ms, p99: 12900 ms), latency samples: 142640
5. check swarm health
Compatibility test for aptos-node-v1.8.3 ==> 46a4788be7c991113f0bdc312ba84723799bfd66 passed
Test Ok

• Grafana dashboard
• Humio Logs
• Axiom Logs
• Test runner output
• Test run is land-blocking

[github-actions]

❌ Forge suite framework_upgrade failure on aptos-node-v1.8.3 ==> 46a4788be7c991113f0bdc312ba84723799bfd66

Compatibility test results for aptos-node-v1.8.3 ==> 46a4788be7c991113f0bdc312ba84723799bfd66 (PR)
Upgrade the nodes to version: 46a4788be7c991113f0bdc312ba84723799bfd66
Test Failed: API error: Unknown error error sending request for url (http://aptos-node-3-validator.forge-framework-upgrade-pr-11694.svc:8080/v1/estimate_gas_price): error trying to connect: dns error: failed to lookup address information: Name or service not known

Stack backtrace:
   0: <unknown>
   1: <unknown>
   2: <unknown>
   3: <unknown>
   4: <unknown>
   5: <unknown>
   6: <unknown>
   7: <unknown>
   8: <unknown>
   9: <unknown>
  10: <unknown>
  11: <unknown>
  12: __libc_start_main
  13: <unknown>
Trailing Log Lines:
   5: <unknown>
   6: <unknown>
   7: <unknown>
   8: <unknown>
   9: <unknown>
  10: <unknown>
  11: <unknown>
  12: __libc_start_main
  13: <unknown>


Swarm logs can be found here: See fgi output for more information.
thread 'main' panicked at 'called `Result::unwrap()` on an `Err` value: ApiError: namespaces "forge-framework-upgrade-pr-11694" not found: NotFound (ErrorResponse { status: "Failure", message: "namespaces \"forge-framework-upgrade-pr-11694\" not found", reason: "NotFound", code: 404 })

Caused by:
    namespaces "forge-framework-upgrade-pr-11694" not found: NotFound

Stack backtrace:
   0: <unknown>
   1: <unknown>
   2: <unknown>
   3: <unknown>
   4: <unknown>
   5: <unknown>
   6: <unknown>
   7: <unknown>
   8: <unknown>
   9: <unknown>
  10: <unknown>
  11: <unknown>
  12: <unknown>
  13: <unknown>
  14: <unknown>
  15: __libc_start_main
  16: <unknown>', testsuite/forge/src/backend/k8s/swarm.rs:676:18
stack backtrace:
note: Some details are omitted, run with `RUST_BACKTRACE=full` for a verbose backtrace.
Debugging output:

• Grafana dashboard
• Humio Logs
• Axiom Logs
• Test runner output
• Test run is land-blocking