New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Feature]: Support creating guardrails on UI #3584

Open

5 tasks

krrishdholakia opened this issue May 11, 2024 · 0 comments

Open

5 tasks

[Feature]: Support creating guardrails on UI #3584

krrishdholakia opened this issue May 11, 2024 · 0 comments

Labels

Contributor

krrishdholakia commented May 11, 2024 •

edited

The Feature

Similar to bedrock - support creating guardrails on the UI

Screenshot 2024-05-11 at 12 35 49 PM

We already support all the underlying things they're doing here

content filtering - LLM Guard https://docs.litellm.ai/docs/proxy/enterprise#content-moderation-with-llm-guard
ban topics - LLM Guard https://docs.litellm.ai/docs/proxy/enterprise#content-moderation-with-llm-guard
word filters - https://docs.litellm.ai/docs/proxy/enterprise#enable-banned-keywords-list
PII redaction - via presidio - https://docs.litellm.ai/docs/proxy/pii_masking
Blocked message response - via Call Hooks - https://docs.litellm.ai/docs/proxy/call_hooks

Motivation, pitch

implement guardrails across providers

Why guardrails?

allows teams to ship products to prod quickly

Twitter / LinkedIn details

No response

krrishdholakia added the enhancement label

krrishdholakia mentioned this issue

Contributing - UI #3579

Open

8 tasks

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment