Pass HTTP auth secrets using v2 manifest format

[mattjohnsonpint]

• Uses v2 manifest format
• Handles auth secrets in all outbound HTTP calls
• Pre-caches all secrets for the backend at startup, and monitors for changes
• Misc refactoring and cleanup
• Update readme file

Completes HYP-1207

[linear]

HYP-1207 Host authentication needs serious improvement

Currently we support a single "API Key" for each host. We allow the user to enter it in the console, we save it to Secrets Manager, and we assign it to a header on outbound requests where the header is specified by authToken in the manifest.

This is very limiting, as there are many different kinds of authentication schemes used by APIs. Many APIs pass tokens on the url query string, or in the request body, or other locations. Some require more complex short-lived tokens to be generated on the fly, etc.

Even with the current approach it's not ideal for the user because they have to include the entire header - not just their auth token. For example, if using GitHub API, if your token is "abc123" you have to enter "BEARER abc123", in the console. The auth scheme should be separate from the token.

For APIs that use HTTP Basic authentication, they need a username and password - both of which should be secret. We then have to compose the Authorization header according to RFC 7617. i.e, Authorization: Basic <base64(<username>:<password>)>.

APIs that require short-lived JWTs may need some support for generating them based on other credentials (private keys, etc.)

We should break this out into several items to support each auth scheme, and work from the user backwards. ie., start from the function, through to the runtime, then the manifest, and ultimately the console.

[sentry-io]

Suspect Issues

This pull request was deployed and Sentry observed the following issues:

• ‼️ Error: environment variable HYPERMODE_METADATA_DB was not found hmruntime/db in Initialize View Issue
• ‼️ Error: operation error Secrets Manager: ListSecrets, https response error StatusCode: 400, RequestID: 13... hmruntime/secrets in (*awsSecretsProvider).moni... View Issue

_{Did you find this useful? React with a 👍 or 👎}