Deliverer of ideas for a living. Believer in internet autonomy, dignity. I upkeep instances of FOSS platforms like this for the masses. Previously on Twitter under the same handle. I do software things, but also I don’t.

  • 0 Posts
  • 41 Comments
Joined 2 years ago
cake
Cake day: June 5th, 2023

help-circle

  • Hello! I recently deployed GPUStack, a self-hosted GPU resource manager.

    It helps you deploy AI models across clusters of GPUs, regardless of network or device. Got a Mac? It can toss a model on there and route it into an interface. Got a VM on a sever somewhere? Same. How about your home PC, with that beefy gaming GPU? No prob. GPUStack is great at scaling what you have on hand, without having to deploy a bunch of independent instances of ollama, llama.ccp, etc.

    I use it to route pre-run LLMs into Open WebUI, another self-hosted interface for AI interactions, via the OpenAI API that both GPUStack and Open WebUI support!




  • What’s your hypervisor manager? Or are you just bare metal?

    For VMWare and Proxmox both, I would recommend the community edition of Veeam. It can handle up to 10 VMs for free.

    If you’ve got the funds as a small-to-large business, Veeam’s first paid tier, on a yearly basis, is a solid option to backup even more.

    Caveat emptor if you buy a license (or not): Veeam runs on Windows only. I have used, like, a single internal network Windows VM dedicated just to Veeam before. It has an easy to pick up UX after a little research, and the UI is clean.

    Bacula is deprecated, unfortunately.







  • Thinkpads – a laptop with a rich history of Linux use – can be bought with an integrated 4090. The ThinkPad P1 Gen 6 can be configured with an i9, plenty of flexibility for drive space and RAM, and an RTX 4090. It’ll run you, even used, around $3k to $4k, which is the equivalent of a desktop replacement. But it’ll be pretty doggone compatible with any Linux distro you’d like.



  • Use the user profiles feature of grapheneos to make a “social” profile and only use that to access Instagram / facebook.

    You’ll want to consider isolating IG from your primary profile, to start. The above user’s suggestion hits the nail on the head.

    Once the profile ks created, and you’ve installed IG, you’ll want to deselect the option in your Manage Profiles settings on GrapheneOS to ‘Allow running in the backgroud.’ This way, you can ensure the app is entirely stopped until you want it open.

    Another consideration may be to turn off your Bluetooth when it’s not in use, as well: BT emits an ‘address’ of sorts that, if another IG user has enabled BT access on their IG app, may be able to detect your phone and track a conversation knowing you are in the other user’s vicinity.