Answering Destiny’s LLM question from Foodshops Stream, 9/7

Putting sensitive documents into LLMs is one thing that most LLMs agree is a huge opsec risk.

The way to get the benefits of generative AI for simple things like formatting a CSV list into individual cells is by locally hosting your own LLM using something like Llama.

This gets really powerful when you integrate it into Obsidian using the Co-Pilot plug-in. It essentially creates your own offline LLM that’s being trained off of your data to work specifically for you.

Here’s the video I used to set up co-pilot & smart connections. My Llama instance is running on my personal M4 Mac Mini as a background app. I can only imagine how much more headroom Destiny would have with this set up, seeing as he’s using two computers for his stream and that they both seem kitted the fuck out.