Standardized spec and vendor-specific transforms for ChatML
-
Updated
May 27, 2024 - Python
Standardized spec and vendor-specific transforms for ChatML
Call many AIs from a single API.
Genshin Impact Character Chat Models tuned by Lora on LLM
EchoSight is a tool that helps visually impaired individuals by audibly describing images taken with a Raspberry Pi Camera or inputted via image path or URL across different operating systems.
Evaluate open-source language models on Agent, formatted output, command following, long text, multilingual, coding, and custom task capabilities. 开源语言模型在Agent,格式化输出,指令追随,长文本,多语言,代码,自定义任务的能力基准测试。
Chat with Lex! A RAG app, using HyDE with milvus DB for vector store, VLLM for LLM inference, and FastEmbed for Embeddings!
MLOps library for LLM deployment w/ the vLLM engine on RunPod's infra.
This repository has a lot of LLM projects done. It is the best place to start learning LLM.
An simple implementation of Unet because all the implementations i've seen are wayy tooo complicated.
Run code inference-only benchmarks quickly using vLLM
Examples of serving LLM on Modal.
A discord bot which can call LLMs using either Hugging Face or vLLM on Windows platform. Combined with function calling.
Embedding based semantic search app for poetry [App and EDA notebooks]
Preserving entities through the integration of knowledge graphs, Llama 2, vLLM, and LangChain.
Add a description, image, and links to the vllm topic page so that developers can more easily learn about it.
To associate your repository with the vllm topic, visit your repo's landing page and select "manage topics."