Hardware guides for local AI. GPU comparisons, VRAM requirements, budget builds, and real-world benchmarks from our actual infrastructure.
Guides
(More coming soon — we’re building this site out live.)
Hardware guides for local AI. GPU comparisons, VRAM requirements, budget builds, and real-world benchmarks from our actual infrastructure.
(More coming soon — we’re building this site out live.)
Open Source Sustainment And The Future Of Gitea Welcome back to Self-Hosted Tech! If you’ve been running a homelab for any amount of time, you probably have a stack of old mini PCs, a repurposed enterprise server, or maybe a cluster of Raspberry Pis humming away in your closet. But hardware is only half the equation. The true magic of the homelab comes from the open-source software we run on that hardware. ...
AMD ROCm vs. Vulkan Performance for Lemonade Local AI Server with Llama.cpp Welcome back to Self-Hosted Tech! If you’ve been following the local AI revolution, you already know that Nvidia’s CUDA ecosystem has been the undisputed king of the hill. But here in the homelab community, we love a good challenge, and many of us have AMD GPUs sitting in our rigs gathering dust while we wait for the software ecosystem to catch up. ...
One Year Later: Sovereign Ai And The Fight For Choice It’s been just over a year since the local AI landscape experienced a massive paradigm shift. If you rewind to early 2023, running a Large Language Model (LLM) at home was largely considered a novelty. You needed a deep understanding of Python, complex dependency management, and a willingness to watch your computer sweat through a 7-billion parameter model at a sluggish two tokens per second. ...
GPU VRAM Explained for Local AI Welcome back to the blog! If you’ve been hanging out in homelab circles, browsing local AI subreddits, or watching our channel lately, you’ve probably noticed one term being thrown around more than any other: VRAM. When you build a server for traditional self-hosted apps like Plex, Nextcloud, or Pi-hole, you usually worry about CPU cores, system RAM, and storage speed. But when you step into the world of local AI—running your own Large Language Models (LLMs) or generating images with Stable Diffusion—the rules change completely. The CPU takes a backseat, and the Graphics Processing Unit (GPU) becomes the star of the show. ...
GPU buying guide for local AI — VRAM tiers, benchmarks, and which models run on each card.