So it's really between a hosted eu chat, or a self hosted open weight model, its a matter of setup effort/gpu cost v trust of a 3rd party.
imo most people should be hosted at first, and only self-host if you already have a decent GPU
- Mistral Le Chat (french co) has a free version with ~20-25 messages a day soft cap,
--Pro $14.99/month and Team $24.99/user/month
--con: pro is marketed unlimited, but about 120-150 standard messages when using, and model pool is smaller than openai / anthropic offering
- Proton Lumo (swiss, same as protonmail) - has a free version w/ no account needed
-- Lumo Plus $12.99/month or $9.99/year for billing. they run models/data processing at EU datacenters. proton says they don't use conversations for training.
-- con: you quickly hit limits on messages/image generation for free on daily use - only proton unlimited is the free tier - not too many features
self hosting is the most independent option. For example, Mistral Small 3.1 (24B) you need ~13-14GB at Q4 quantization, which fits on a 16GB GPU. some guides say ~55tps on RTX4080. Mistral Small 4 is much larger, ~72.6GB at Q4 quantization, you need like an 80gb card or high mem mac. Qwen 27B should be great actually.
problem is that you are responsible for setup and updates and quality not as high as current frontier hosted models. generally you add a front end of your own to deal with files/search with something like ollama
EU hosted wrappers are in the middle but look at subprocessor list. if you have a wrapper that is just sending prompts to a US model API, your text is still going to a US co.
-- con: shorter track record - trusting their infrastructure claims but can't audit
For comparison, ChatGPT Plus is $20/month on US infrastructure. So the baseline to compare against
I ended up with an eu hosted wrapper because i want daily chat without needing a gpu. I'm willing to give up a bit of control that I'd have with self hosting. For most folks le chat/lumo is good for daily use, and you only self host if you have 16gb+ card you already have.
Whats your paid for stuff, is it more the location hosted or monthly price how you decide?