How to Use AI With Your Privacy Intact
www.wired.com
Your conversations with AI chatbots are both highly personal and deeply vulnerable to surveillance. Here’s how you can protect yourself.

Very confused, is this all BS?

“Confer, the private AI chatbot launched by Signal creator Moxie Marlinspike, uses that Nvidia-based TEE setup— along with an authentication system…”

“Meta, too, uses a TEE to offer a more private version of the Meta AI chatbot included in WhatsApp—a privacy system that Confer’s Marlinspike has said he is helping Meta to develop.”

This feels too good to be true and I am surprised this article is the first i am hearing about the relationship between Marlinspike and Meta for this product.

  • Matt@lemmy.ml
    21·
    1 day ago

    Just install Ollama and pull a model from their registry.

    • tiny@midwest.socialEnglish
      2·
      22 hours ago

      You need a minimum of 16gb of vram in order to do anything that requires tool calls and even then it is slow. Running llms locally is a fun challenge and it’s impressive what can be done on consumer hardware but it isn’t cheap or simple

      • Matt@lemmy.ml
        1·
        11 hours ago

        Yeah. But you at least have the incentive to upgrade.

        I still have my GTX 1660super I want to upgrade to something better so that I can save on my AI subscription (unlike a sub you actually own it and can run whatever open weight model you desire).