How should we position Jan?

[dan-jan]

I'd like to create an open discussion on how we should position Jan.

Why is this a concern?

• Imho, Jan's product positioning and messaging is not strong
  • Our team is mostly product & engineering, and are not natural marketing people
  • We are especially weak at marketing towards "normies", as we have been on the bleeding edge for so long
• More importantly, I think there is a bigger need to educate consumers on Local and open-source AI
  • ChatGPT has entered the zeitgeist, while Local AI is only known by a group of nerds
  • How do we convince people to run AI on their own laptops?

Where we are now

• Jan is a very young product, our first stable release was on 20th December
  • We have mostly grown from word-of-mouth, and our growth has come from a few r/localllama comments
  • We don't even have social media accounts set up yet (e.g. Twitter, Reddit)
  • We haven't done a real announcement post (e.g. ProductHunt, Hackernews, r/localllama)

Our current value propositions

I would break down Jan's current "word-of-mouth" value propositions, by Crossing the Chasm populations.

Innovators

• e.g. AI researchers, engineers: r/localllama, AI Engineering Twitter, AI Discords
  • Jan is not designed for this group, and I find the dynamics in this group very "competitive" (science club-like)
  • I would rather focus on educating the remaining 4.6 billion computer owners on what Local AI can do
• "You mean I can fork Jan and offer it to my customers commercially?"
  • That said, Jan can be used by "innovators" group in their businesses (e.g. AI consultancies)
  • AI consultants can deploy Jan for their customers (as an alternative to ChatGPT) and charge customers
  • AI consultants can (in the future) develop custom assistants on top of Jan, and let clients run the Assistants on their own Jan Desktops
  • [Not sure yet] AI consultants can optionally license Jan to whitelabel and close source it

Early Adopters: AI Enthusiasts

• e.g. Local AI users: r/localllama, AI enthusiasts
  • This is the surest bet, but there are several different tools available
• Value Prop: "Jan is an open source alternative to LMStudio"
  • This is the nearest adjacent product, as "polished" Desktop Apps that allow users to run Local LLMs
  • However, I don't like this as I think open/closed source are both valid decisions, and imho LMStudio and Jan will have very different long-term niches
  • I dislike equating open source with virtue = we all need to somehow pay the bills, and in our case OSS aligns with our commercialization model
  • I actually think we should work with LMStudio, Ooba and others to grow the Local AI pie
• Value Prop: Jan is simpler to use than other tools
  • "I would recommend normal users use Jan instead of Ollama, because it's simpler"
  • "Oh nice, Jan is easier to use than Oobabooga... I can actually recommend this for my office"
  • "Oh cool, you're just a 1-click install, no need for anyone to understand Docker"
• Jan works across Windows, Mac and Linux seamlessly
  • "Jan is an open source Desktop AI for you to try the latest LLMs and customize how they work"

Early Adopters: Developers

• Value Prop: Drop-in replacement for OpenAI's API and platform
  • Developers just need to change https://api.openai.com to localhost:1337
  • We aim to offer full API compatibility, see https://jan.ai/api-reference/
  • Not just /chat/completions but the full API
• Value Prop: I can experiment, tinker with Local LLMs to find one that is suitable for my app
  • Find a LLM that works well with reasoning tasks, logical tasks etc

Early Majority: Consumers

• e.g. "Normal people" who currently use ChatGPT, and are just realizing local and open source AI exists
• Value Prop: Local, offline alternative to ChatGPT
  • "Jan is a local, private alternative to ChatGPT that runs only on your computer"
  • "Wow, you mean this works without the internet?"
• Value Prop: No subscription fees
  • "Wow, you mean I don't need to pay ChatGPT $20 a month?"
  • "Wow, you mean this is free?"
• Value Prop: Privacy
  • "Wow, you mean my data doesn't leave my computer?"
  • Hmm...
• Value Prop: 10x your productivity
  • This is our longer-term roadmap, and not really where we are now

Early Majority: Businesses

• e.g. We have a version of Jan that is a full "ChatGPT-alternative" that businesses can deploy on-prem or on their own AWS
  • Value Prop: Provide an self-hosted alternative to ChatGPT (i.e. privacy, data protection etc)
• e.g. This version of Jan can also be used to host a custom LLM, that is customised to their needs
  • Value Prop: Fine-grained control of their AI (i.e. works deterministically, not a black box)
  • Value Prop: Not beholden to OpenAI (e.g. downtime, policy changes, rate limits)

Current Features

Public Roadmap: https://github.com/orgs/janhq/projects/5/views/16

• Works on Windows, Linux, Mac
• Desktop App (doesn't require Docker, CUDA)
• Very simple to run Local AI
• 1-click model downloads
• API server that runs at localhost:1337 (OpenAI-compatible API)
• System Monitor (e.g. CPU, RAM, Hardware usage)
• Open Source (i.e. code can be audited prior to deployment)

One important note: we are having a bunch of teething issues on Windows, but these are being rapidly fixed and I anticipate Windows will be fairly stable by end-Jan.

Upcoming features:

• Jan Server (multi-user, for businesses)
• Desktop Extensions (i.e. Grammarly-like)
• Mobile Extensions
• Assistants Framework
• Extensions (similar to VSCode)

Current Misconceptions

• Jan runs other open source AIs, and isn't an AI by itself
  • Models: OpenHermes, Mistral etc
  • We often have to explain to people we don't provide the AI, rather we're a tool for them to run popular Open Source AIs
• "Oh, you guys are just putting a UI"
  • Jan is building a full ecosystem and platform to support the adoption of open source AI
  • We're going to build the tooling required to make open source a viable alternative to OpenAI/ChatGPT
  • Simple things like "don't crash on Windows 10", "no need to understand command line"
• "Oh, you guys are just a UI on top of llama.cpp"
  • Jan is actually a fully modular framework, similar to VSCode
  • We support llama.cpp as one inference engine, but will be adding more soon (e.g. TensorRT-LLM, Apple's MLX)
  • Our goal is to make it possible for our mom to run local AI - not just at a UI level, but at a "automagical experience" engineering level

Resources

• Why Jan? https://jan.ai/guides/
• Why does Jan exist? https://jan.ai/about/#why-does-jan-exist (outdated)

[Techeters]

One of the common failures of technical founders with marketing is that they explain what a product does, and not specifically what it does for users. When looking at these groups, we have to see what is important and common for innovators and early adopters:

ChatGPT has a cost
Privacy is an issue
ChatGPT is limited in capability
LLMs are great, but there are too many of them

So while everything in this document is accurate towards what Jan is great at and why it is relevant, the messaging can be fine tuned to more closely resemble the fact that most users/businesses don't want to pay for LLM, are highly concerned with privacy (especially for businesses and US-based users), ChatGPT is really restricted, and most users don't know which LLM is best to use.

"Jan is free to use, taps into multiple LLMs so you don't have to choose, has a wider range of capabilities than a single LLM, and is private and secure to your local server or computer"

[Techeters]

Does Jan have capabilities for enterprise clients and if not, how soon could it be ready for enterprise sales?

[JiveyGuy]

One use I think that Jan would be amazing for us local use in classified environments where use of a cloud LLM is impossible. This would allow rapid adoption of generative tools in these antiquated areas where even googling something is hard. Having access to a tool that you could ask simple things you would otherwise need to walk outside to learn would be a huge enterprise usecase with lots of funding.

[ghost]

I think Jan should position itself as a hub for AI tools that can be accessible from anywhere, including computers, phones, and browsers. There is already a lot of competition between huge companies, as they often end up copying and adding features that most start-ups come up with. And people just stop using these apps and prefer these big companies. However, the biggest disadvantage of these big companies is that they can only offer their own services.

This is where Jan jumps in. If we want Jan to not be affected by these companies and their almost unlimited money, Jan should offer users the ability to use any tool they want.

Jan should offer; ChatGPT, Google Bard, Microsoft Co-Pilot / Dall-E, Stable Diffusion, or any LLM / MLLM that users want to download and use offline in one place.

I hope you can see my point. If Jan (or any other app) wants to survive in this harsh area, it should constantly integrate these tools and get benefit from. That will make Jan Future-proof. Otherwise, one day, a big tech company could release an app or add a feature that makes Jan functionless. If the core feature of Jan is running it locally and offline, there is a high possibility of losing its functionality in the future.
Instead of advertising it as "ChatGPT Alternative, %100 Offline" it would be much better to advertise it as "an all-in-one alternative for using AI." that also runs locally.

So, my take on this discussion; Jan should be the ultimate tool that effortlessly/easily usable to regular users, offers detailed functionality to power users, and allows enterprises to build their own solutions with it.

[0xgokuz]

Our current mission is to allow humans and businesses to own their AI, with the right to tinker, repair and innovate.

Looking at your mission. I believe your positioning should be building the best developer tools to empower developers build and integrate A.I. easily however they want

So what does developer wants?

• Control - data, privacy, etc
• Open Platform - integrate, etc
• Can use whatever models they want - and combine, train, etc

Developers, Developers, Developers

[TomLucidor]

The layering:

• The Open LLM models for Privacy - LM Studio curation did this well
• Smooth UX for usability - need to be multi-modal and handle multiple architectures
• RAG - Has to beat tools like Khoj and GPT4All (which can handle both documents and smart notebooks like LogSeq)
• (optional) "Auto" operation agents - be able to search the web for info and cache webpages in multiple ways
• (optional) Interaction and conversation - be able to take multiple points of view and act like ChatDev or MetaGPT or ChatArena

[Nierusan]

À maybe stupid comment but I tried several apps to test gpt and else and all of them miss one thing. A search into prompt.

So I have to launch new prompt everytime and sometimes I know I ask for it 20 times already but without a way to search I won't be able to find my previous prompt.