An Ai engineer's tool for building custom Ai agents and workflows for use in your own applications or everyday life.
- ✅ Run open source models locally for free
- ✅ Streaming chat UI
- ✅ Chat with your documents (RAG)
- ✅ Build custom bots from a mix of LLM's, software configs and prompt configs
- ✅ CPU & GPU support
- ✅ Windows OS build
- ✅ Save chat history
- ❌ MacOS & Linux builds
- ❌ Build assistants with access to tools
- ❌ Orchestrate multiple assistants in a team
- ❌ Share model configs with community
This is a local model first project. We have future plans to support cloud inference providers as a config option.
- ✅ Local
- ❌ OpenAI
- ❌ Google Gemini
- ❌ Anthropic
- ❌ Mistral AI
- ❌ Groq
This will start a local development server with hot-reloading.
pnpm i
pnpm dev
To production:
vercel deploy --prod
To preview:
vercel deploy