Backport of FLAKEY_TEST: Add retry to outbound request for ProxyLifecycleShutdown… into release/1.2.x

[hc-github-team-consul-core]

Backport

This PR is auto-generated from #3999 to be assessed for backporting due to the inclusion of the label backport/1.2.x.

The below text is copied from the body of the original PR.

---

Changes proposed in this PR

• Test fails intermittently in CI (for some reason it only fails in cloud environment not kind clusters) see example here
• Add retry to outbound API calls to improve chance of success.
  • if error occures, log the error and mark the current attempt as failed, trigger a retry.
  • If error does not exist, check if the output contains the specific error message. If the condition fails, log the error message and trigger a retry.

How I've tested this PR

CI should pass

How I expect reviewers to test this PR

CI should pass

Checklist

• Tests added
• CHANGELOG entry added

---

Overview of commits

• b547902 - b7ecab4 - 2fcccd2