Yeah, I got a superbly functional and super fast search / research / assistant tool from Qwen 3.6 35B and Open Web UI + SearXNG. All running local. It passed the WAF benchmark with flying colors.
It’s honestly incredible how good the local stack is nowadays. It’s literally better than any frontier model you could’ve rented like a year ago.
*counts world population*
[ ! ]
Why does Ollama only have a cloud version?
Because how else will they take care of vendor lock-in without such requirement?
What is the difference between running locally and running on Qwen platform?
I do not have a capable computer to run this I am just interested
Mainly data sovereignty. Running a local model means all your data stays on your machine. Any time you use a service you’re sending whatever the model is working on to the company. Another advantage is the price. With services you have to pay a subscription, with local models you get to run them for the price of electricity.
And electronic devices
