I really like Jan, especially the organization's principles: https://jan.ai/
Main deal breaker for me when I tried it was I couldn't talk to multiple models at once, even if they were remote models on OpenRouter. If I ask a question in one chat, then switch to another chat and ask a question, it will block until the first one is done.
Also Tauri apps feel pretty clunky on Linux for me.
signbcc · 39s ago
> especially the organization's principles
I met the team late last year. They’re based out of Singapore and Vietnam. They ghosted me after promising to have two follow-up meetings, and were unresponsive to any emails, like they just dropped dead.
Principles and manifestos are a dime a dozen. It matters if you live by them or just have them as PR pieces. These folks are the latter.
diggan · 2h ago
> Also Tauri apps feel pretty clunky on Linux for me.
All of them, or this one specifically? I've developed a bunch of tiny apps for my own usage (on Linux) with Tauri (maybe largest is just 5-6K LoC) and always felt snappy to me, mostly doing all the data processing with Rust then the UI part with ClojureScript+Reagent.
_the_inflator · 2h ago
Yep. I really see them as an architecture blueprint with a reference implementation and not so much as a one size fits all app.
I stumbled upon Jan.ai a couple of months ago when I was considering a similar app approach. I was curious because Jan.ai went way beyond what I considered to be limitations.
I haven’t tried Jan.ai yet, I see it as an implementation not a solution.
c-hendricks · 3h ago
Yeah, webkit2gtk is a bit of a drag
klausa · 1h ago
So this is how women names Siri felt in 2011.
lagniappe · 31m ago
Hello Jan ;)
jwildeboer · 30m ago
My name is Jan and I am not an AI thingy. Just FTR. :)
underlines · 18m ago
Jan here too, and I work with LLMs full time and I'm a speaker about these topics. Annoying how many times people ask me if Jan.ai is me lol
dsp_person · 13m ago
We need a steve.ai
biinjo · 4h ago
Im confused. Isn’t the whole premise of Ollama that its locallt ran? What’s the difference or USP when comparing the two.
hoppp · 3h ago
I think its an alternative because ollama has no UI and its hard to use for non-developers who will never touch the CLI
Huh, yeah it looks like the GUI component is closed source. Their GitHub version only has the CLI.
diggan · 2h ago
I think at this point it's fair to say that most of the stuff Ollama does, is closed source. AFAIK, only the CLI is open source, everything else isn't.
conradev · 1h ago
Yeah, and they’re also on a forked llama.cpp
moron4hire · 4h ago
That's not the actual tagline being used in the repo. The repo calls itself an alternative to ChatGPT. Whoever submitted the link changed it.
mathfailure · 4h ago
Is this an alternative to OpenWebUI?
apitman · 3h ago
Not exactly. OWUI is a server with a web app frontend. Jan is a desktop app you install. But it does have the ability to run a server for other apps like OWUI to talk to.
ekianjo · 2h ago
Openweb-ui does not include a server.
apitman · 2h ago
I was referring to Jan.
roscas · 6h ago
Tried to run Jan but it does not start llama server. It also tries to allocate 30gb that is the size of the model but my vram is only 10gb and machine is 32gb, so it does not make sense. Ollama works perfect with 30b models.
Another thing that is not good is that it make constant connections to github and other sites.
hoppp · 3h ago
It probably loads the entire model into ram at once while ollama solves this and does not, it has a better loading strategy
SilverRubicon · 4h ago
Did you see the feature list? It does not deny that makes connections to other sites.
- Cloud Integration: Connect to OpenAI, Anthropic, Mistral, Groq, and others
- Privacy First: Everything runs locally when you want it to
reader9274 · 2h ago
Tried to run the gpt-oss:20b in ollama (runs perfectly) and tried to connect ollama to jan but it didn't work.
I tried Jan last year, but the UI was quite buggy. But maybe they fixed it.
diggan · 2h ago
Please do try it out again, if things used to be broken but they no longer are, it's a good signal that they're gaining stability :) And if it's still broken, even better signal that they're not addressing bugs which would be worse.
esafak · 2h ago
So you're saying bugs are good?!
diggan · 2h ago
No, but maybe that their shared opinion will be a lot more insightful if they provide a comparison between then and now, instead of leaving it at "it was like that before, now I don't know".
semessier · 3h ago
still looking for vLLM to support Mac ARM Metal GPUs
baggiponte · 2h ago
Yeah. The docs tell you that you should build it yourself, but…
venkyvb · 2h ago
How does this compare to LM studio ?
rmonvfer · 1h ago
I use both and Jan is basically the OSS version of LM Studio with some added features (e.g, you can use remote providers)
I first used Jan some time ago and didn’t really like it but it has improved a lot so I encourage everyone to try it, it’s a great project
angelmm · 1h ago
For me, the main difference is that LM Studio main app is not OSS. But they are similar in terms of features, although I didn't use LM Studio that much.
Main deal breaker for me when I tried it was I couldn't talk to multiple models at once, even if they were remote models on OpenRouter. If I ask a question in one chat, then switch to another chat and ask a question, it will block until the first one is done.
Also Tauri apps feel pretty clunky on Linux for me.
I met the team late last year. They’re based out of Singapore and Vietnam. They ghosted me after promising to have two follow-up meetings, and were unresponsive to any emails, like they just dropped dead.
Principles and manifestos are a dime a dozen. It matters if you live by them or just have them as PR pieces. These folks are the latter.
All of them, or this one specifically? I've developed a bunch of tiny apps for my own usage (on Linux) with Tauri (maybe largest is just 5-6K LoC) and always felt snappy to me, mostly doing all the data processing with Rust then the UI part with ClojureScript+Reagent.
I stumbled upon Jan.ai a couple of months ago when I was considering a similar app approach. I was curious because Jan.ai went way beyond what I considered to be limitations.
I haven’t tried Jan.ai yet, I see it as an implementation not a solution.
- Cloud Integration: Connect to OpenAI, Anthropic, Mistral, Groq, and others
- Privacy First: Everything runs locally when you want it to
Can't make it work with ollama endpoint
this seems to be the problem but they're not focusing on it: https://github.com/menloresearch/jan/issues/5474#issuecommen...
I first used Jan some time ago and didn’t really like it but it has improved a lot so I encourage everyone to try it, it’s a great project