I’m David. I live in Tacoma, Washington. I do square foot gardening, home automation with Home Assistant, and have too many cats.

You think you saw me behind some ferns? You just might have!

  • 0 Posts
  • 30 Comments
Joined 1 year ago
cake
Cake day: July 31st, 2023

help-circle



















  • Have you played around with hosting your own LLM? I’ve just started running oobabooga, it lets you download various LLMs and host them. I’ve been working on getting it set up so the AI can provide text for Piper, and take input from Whisper. It requires ideally an nvidia card, but will work with AMD and CPU. That would let you use the API to get text for piper to read. It’s a lot more privacy oriented than sending your queries off to ChatGPT. The larger models do take more CPU/RAM/VRAM to run, but perhaps a smaller tuned model would suit your needs.