Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Feature]: Implement OpenAI moderation as a guardrail #8490

Open
superpoussin22 opened this issue Feb 12, 2025 · 0 comments
Open

[Feature]: Implement OpenAI moderation as a guardrail #8490

superpoussin22 opened this issue Feb 12, 2025 · 0 comments
Labels
enhancement New feature or request mlops user request

Comments

@superpoussin22
Copy link
Contributor

The Feature

being able to pass every prompt to the openai omni moderation model before sending it to the requested model

Motivation, pitch

it will reduce the cost of sending bad prompt to a model and pay for tokens

Are you a ML Ops Team?

Yes

Twitter / LinkedIn details

No response
@superpoussin22 superpoussin22 added the enhancement New feature or request label Feb 12, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request mlops user request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@superpoussin22