-
Notifications
You must be signed in to change notification settings - Fork 5k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
feat: Add Amazon Bedrock as LLM provider #2769
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Hi @ebaizel! Welcome to the ai16z community. Thanks for submitting your first pull request; your efforts are helping us accelerate towards AGI. We'll review it shortly. You are now a ai16z contributor!
Important Review skippedAuto reviews are disabled on this repository. Please check the settings in the CodeRabbit UI or the You can disable this status message by setting the Thank you for using CodeRabbit. We offer it for free to the OSS community and would appreciate your support in helping us grow. If you find it useful, would you consider giving us a shout-out on your favorite social media? 🪧 TipsChatThere are 3 ways to chat with CodeRabbit:
Note: Be mindful of the bot's finite context window. It's strongly recommended to break down tasks such as reading entire modules into smaller chunks. For a focused discussion, use review comments to chat about specific files and their changes, instead of using the PR comments. CodeRabbit Commands (Invoked using PR comments)
Other keywords and placeholders
CodeRabbit Configuration File (
|
Relates to
#2753
Risks
Low risk: the changed code should only impact a runtime when Amazon Bedrock is used as a provider. Otherwise, the existing code should not be impacted.
Background
What does this PR do?
It adds Amazon Bedrock as an LLM provider, making available the Amazon Nova family of LLMs, as well as LLMs from several other providers.
What kind of change is this?
Feature (non-breaking change which adds functionality)
Why are we doing this? Any context or related work?
Some developers may have credits or tokens that can only be consumed via AWS (Amazon Bedrock), and this offers them an opportunity to use those.
Also, Amazon Nova models are cost-effective, intelligent models that could be well-suited for Eliza agents.
Documentation changes needed?
My changes do not require a change to the project documentation.
Testing
I created a character and set the model to nova-micro, and verified I could generate text that then got included as a tweet.
Where should a reviewer start?
The two main new pieces of functionality are in generateText and generateObject.
Detailed testing steps
To test
generateText
, set a character to use one of the Bedrock models (eg, nova-lite-v1). Then start the character and ask it something, which will then lead it to invokegenerateText
NOTE: I could use help testing out the
generateObject
functionality.Discord username
pixel_pavel