I wonder if a 1B model could be close to free to host. That's an eventuality, but I wonder how long it'll take for that to be real.
codazoda · 2h ago
I’m planning to deploy a 1B model, feed it all the documents I’ve ever written, host it on a $149 mini-PC in my bedroom, and enable you to chat with it.
I’ve released similar projects before.
I’ll drop a post about my plans in the coming days and I’ll build and document it about two weeks later if there’s enough interest.
joeldare.com
giantrobot · 2h ago
A 1B model at 2-bit quantization is about the size of the average web page anymore. With some WebGPU support you could run such a model in a browser.
I'm half joking. Web pages are ludicrously fat these days.
puppymaster · 44m ago
been using it on a plane for the past one month. it's a great way to do some light reading and learning about obscure topics.
dig @ch.at "why is gua musang the king of durian" TXT +short
w-ll · 2m ago
[delayed]
WhatsName · 4h ago
I find the fact that in this day people can own two letter domains absolutely staggering, based on rarity, those should be worth millions I guess?
abxyz · 1h ago
They paid about $50k for ch.at. I have a single letter country code domain (3 characters total, x.xx). There are still some single letter country code domains available to register, you could get one for under $1k USD if you want one.
These guys run a bunch of services on x.xx domains: https://o.ee/services/ like c.im, r.nf, p.lu.
nunobrito · 2h ago
There was a time that I owned a one letter domain with a two letter country code.
The cost was about 600 USD and was fun, but problematic as it failed to be accepted as valid email address on many websites.
weitendorf · 2h ago
I own vecs.ai and it's surprisingly hard to find buyers. Domains are really just Xoomer NFTs
nadermx · 2h ago
I mean, ch.at is a incredible domain hack. But not sure it's worth millions. If it was ch.com could get mid six figures and up. But either way absolutely amazing domain.
sgjohnson · 2h ago
unless they are .com, nobody cares.
twostorytower · 1h ago
.ai expensive these days too
alhirzel · 58m ago
What are the economics of this?
mattpavelle · 51m ago
This (or something very similar) was on X last week. The use case was so funny: using an LLM on an airplane connected to WiFi when you had not paid for WiFi … because DNS queries are allowed before paying :)
JADev62096 · 47m ago
logging policy?
Nevin1901 · 2h ago
use the new gpt oss to have 0 logs end to end. but cool project
Perhaps via an RNN like in https://huggingface.co/spaces/BlinkDL/RWKV-Gradio-2
Or even just leverage huggingface gradio spaces? (most are Gradio apps that expose APIs https://www.gradio.app/guides/view-api-page)
I’ve released similar projects before.
I’ll drop a post about my plans in the coming days and I’ll build and document it about two weeks later if there’s enough interest.
joeldare.com
I'm half joking. Web pages are ludicrously fat these days.
dig @ch.at "why is gua musang the king of durian" TXT +short
Here’s a reseller with a variety: https://1-single-letter-domains.com/
These guys run a bunch of services on x.xx domains: https://o.ee/services/ like c.im, r.nf, p.lu.
The cost was about 600 USD and was fun, but problematic as it failed to be accepted as valid email address on many websites.