Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: support Nvidia NIMs remote API #2854

Open
0xSage opened this issue May 1, 2024 · 5 comments · May be fixed by #2882
Open

feat: support Nvidia NIMs remote API #2854

0xSage opened this issue May 1, 2024 · 5 comments · May be fixed by #2882
Labels
good first issue Good for newcomers P2: nice to have Nice to have feature type: feature request A new feature

Comments

@0xSage
Copy link
Contributor

0xSage commented May 1, 2024

Problem
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]

Request from user:
https://build.nvidia.com/explore/discover
so this is something I came across. With this we can get access to dbrx, mixtral8x22b through nvdia api
will be good to have them

Success Criteria
A clear and concise description of what you want to happen.

Additional context
Add any other context or screenshots about the feature request here.

@0xSage 0xSage added P2: nice to have Nice to have feature good first issue Good for newcomers type: feature request A new feature labels May 1, 2024
@Realmbird
Copy link

Realmbird commented May 3, 2024

@0xSage
Could I try this first issue I might need help doing this since I will be a beginner

@Van-QA
Copy link
Contributor

Van-QA commented May 6, 2024

hi @Realmbird, feel free to pick it up and draft a PR 🙏 We highly value the contributions of users

@Realmbird Realmbird linked a pull request May 9, 2024 that will close this issue
3 tasks
@Realmbird
Copy link

Current draft #2882

@Realmbird
Copy link

Fixed models not holding params currently working on fixing ids with / in name

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
good first issue Good for newcomers P2: nice to have Nice to have feature type: feature request A new feature
Projects
Status: No status
Development

Successfully merging a pull request may close this issue.

3 participants