-
Notifications
You must be signed in to change notification settings - Fork 39
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
support anthropic structured outputs #142
Conversation
The latest updates on your projects. Learn more about Vercel for Git ↗︎
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Can we apply this technique to OpenAI flavored LLMs that do not have structured output (e.g. llama hosted on together)
Done |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
code mostly lgtm. will test it
package.json
Outdated
"packageManager": "[email protected]", | ||
"resolutions": { | ||
"zod": "3.22.4" | ||
} |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Hm I believe we've moved away from doing this (@manugoyal @ibolmo have context)
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
In this PR's case, the version of zod was different between the proxy and SDK, which was causing some strange type errors. I guess we could manually ensure they are the same?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I think the way we accomplished this in the past was by pinning it in pnpm-lock.yaml
instead. @manugoyal or @ibolmo can help you do this the right way.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Will defer to @ibolmo, as I was only familiar with the resolutions
approach, but now see we are using overrides in other parts of the codebase, such as our internal repo. A quick google suggests that pnpm.overrides
is preferred for pnpm projects.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Yeah I did an override
: https://github.com/braintrustdata/braintrust-sdk/pull/469/files.
I forget the exact reason (something something peer dependency), but if the override doesn't unblock you I can try to hop on and sort it out with you.
No description provided.