Popular repositories

1. jan jan Public

   Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. Multiple engine support (llama.cpp, TensorRT-LLM)

   TypeScript 17.8k 1k

2. cortex cortex Public

   Drop-in, local AI alternative to the OpenAI stack. Multi-engine (llama.cpp, TensorRT-LLM). Powers 👋 Jan

   C++ 1.6k 78

3. awesome-local-ai awesome-local-ai Public

   An awesome repository of local AI tools

   866 71

4. nitro-tensorrt-llm nitro-tensorrt-llm Public

   Forked from NVIDIA/TensorRT-LLM

   Nitro is an C++ inference server on top of TensorRT-LLM. OpenAI-compatible API. Run blazing fast inference on Nvidia GPUs. Used in Jan

   C++ 23 1

5. model-converter model-converter Public archive

   Python 16 4

6. docs docs Public

   Jan.ai Website & Documentation

   MDX 12 3