Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

🍎 feat: Apple MLX as Known Endpoint #2580

Merged
merged 3 commits into from May 1, 2024
Merged

Conversation

Extremys
Copy link
Contributor

Summary

The idea is to propose to add Apple MLX integration with LibreChat allowing like ollama to chat with llms on a Apple Silicon hardware privately. I think LibreChat is a great aggregator UI and give the capability to switch from a self hosted service to an external provider without to have to install multiples chat applications, it is a great feature for the community. :)

Change Type

  • New feature (non-breaking change which adds functionality)
  • Documentation update

Testing

Please describe your test process and include instructions so that we can reproduce your test. If there are any important variables for your testing configuration, list them here.

Test Configuration:

Checklist

  • My code adheres to this project's style guidelines
  • I have performed a self-review of my own code
  • I have commented in any complex areas of my code
  • I have made pertinent documentation changes
  • My changes do not introduce new warnings
  • I have written tests demonstrating that my changes are effective or that my feature works
  • Local unit tests pass with my changes
  • New documents have been locally validated with mkdocs

@danny-avila
Copy link
Owner

thanks for the write up! looks great, just needs the image and I'll merge. Going to spin up a local server for the docs to see how the unicode character looks.

docs/install/index.md Outdated Show resolved Hide resolved
@danny-avila danny-avila changed the title Add integration with Apple MLX 🍎 feat: Apple MLX as Known Endpoint May 1, 2024
@danny-avila danny-avila merged commit d21a056 into danny-avila:main May 1, 2024
2 checks passed
jinzishuai pushed a commit to aitok-ai/LibreChat that referenced this pull request May 20, 2024
* add integration with Apple MLX

* fix: apple icon + image mkd link

---------

Co-authored-by: “Extremys” <“Extremys@email.com”>
Co-authored-by: Danny Avila <danny@librechat.ai>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants