Hardware guides for local AI. GPU comparisons, VRAM requirements, budget builds, and real-world benchmarks from our actual infrastructure.
Guides
(More coming soon — we’re building this site out live.)
Hardware guides for local AI. GPU comparisons, VRAM requirements, budget builds, and real-world benchmarks from our actual infrastructure.
(More coming soon — we’re building this site out live.)
Some Networking Fixes Being Diverted To Linux 7.4, AI/LLM Activity Still Increasing Hey everyone, welcome back to Self-Hosted Tech. If you’ve been following the homelab and self-hosting scene lately, you’ve probably noticed a massive shift in what we’re doing with our spare hardware. Gone are the days when a homelab was just a dusty old desktop running a few Docker containers for Pi-hole and Nextcloud. Today, our racks are buzzing with the hum of high-wattage GPUs, and our storage arrays are filling up with multi-gigabyte model weights. ...
Where We Expect AMD EPYC 9006 CPUs In The Era Of Agentic AI If you’ve been following the self-hosting and local AI scenes over the last couple of years, you know that the conversation has been completely dominated by GPUs. How much VRAM do you have? Can you fit a 70B parameter model in Llama 3? How many RTX 3090s can you safely plug into a single motherboard before your house’s circuit breaker gives up? ...
Corsair Novablade Pro & 8Bitdo Pro 2 Controllers Get Native Support in Linux 7.3-Rc7 Hey there, homelabbers! Welcome back to Self-Hosted Tech. When we talk about self-hosting, homelabs, and local AI, our minds usually jump straight to Docker containers, Proxmox clusters, Kubernetes manifests, and Ollama models running on repurposed GPUs. But today, we’re taking a slight detour into a category that is just as important to the modern homelabber: hardware and gaming. ...
Gmktec Evo-X3 Mini-PC Review: Looking at a 128GB AMD Local AI Box Welcome back to Self-Hosted Tech. If you’ve been hanging around the homelab and self-hosting community for a while, you already know that RAM is king. But when you start dipping your toes into the deep end of the pool with local AI, RAM becomes the emperor, the grand vizier, and the entire royal court all at once. We’ve seen a massive influx of mini-PCs hitting the market lately, but almost all of them cap out at 32GB or maybe 64GB of RAM. That’s fine for running a few Docker containers or a small Proxmox cluster, but it’s a massive bottleneck for running large language models (LLMs) locally. Enter the Gmktec Evo-X3. ...
AMD Ryzen AI Developer Platform OS Updated with ROCm 10.0 and Linux 7.2: What It Means for Your Homelab Hey everyone, welcome back to Self-Hosted Tech. If you’ve been following the local AI and self-hosting scene, you know that the hardware landscape has been shifting rapidly. We’re moving away from the idea that you need a massive, power-hungry, $2,000 GPU just to run a decent local Large Language Model (LLM) or process computer vision tasks. ...
Asus AI Tech 2026 Seoul: Bringing Edge AI to the Homelab Hey everyone, welcome back to Self-Hosted Tech. If you’ve been following the channel for a while, you know we are massive fans of running things locally. Whether it’s your media server, your smart home dashboard, or your password manager, keeping your data inside your own four walls is what the homelab lifestyle is all about. ...
Vulkan API Improvements Coming For The AMD Polaris Gpus With Mesa Radv If you’re anything like me, your homelab closet is a graveyard of older hardware. Among the dusty motherboards, tangled Ethernet cables, and retired power supplies, there’s a good chance you have an older AMD graphics card sitting in an anti-static bag. Specifically, I’m talking about the Polaris generation—the legendary RX 400 and RX 500 series cards. ...
Introducing Web Search API Via AI Gateway If you’ve been hanging around the homelab community for any amount of time, you know that our setups evolve. We start with a simple Raspberry Pi running Pi-hole, move on to a NAS for our media, and eventually, we find ourselves racking servers in our closets to run our own AI models. Welcome to the modern homelab. As local AI has exploded, thanks to projects like Ollama, text-generation-webui, and vLLM, we’ve run into a very familiar problem: our local Large Language Models (LLMs) are trapped in time. They know everything up to their training cutoff date, but ask them who won the game last night or what the current weather is in your city, and they’ll confidently hallucinate an answer. ...
Show HN: Giving Opus 5.5 A Simulated Paint Canvas Welcome back to Self-Hosted Tech! If you’ve been hanging around the homelab and local AI communities lately, you’ve probably seen the explosion of agentic workflows. We’ve been moving past simple chatbots and into territory where LLMs write code, execute it, evaluate the results, and try again. Recently, a fascinating project popped up on Hacker News titled “Giving Opus 5.5 A Simulated Paint Canvas.” The premise was brilliantly simple: what if you gave a state-of-the-art language model a blank digital canvas, a set of virtual paintbrushes, and told it to paint a picture? ...
Nvidia Olympus SMT Optimizations for Vera CPU: Squeezing Out 3-6% Performance Gains in Your Homelab If there is one thing we love in the self-hosting and homelab community, it’s free performance. Whether you’re running a massive Proxmox cluster in a repurposed server rack, hosting your own media empire via Jellyfin, or churning through local LLM inference with llama.cpp, every ounce of compute matters. Recently, a fascinating update dropped in the enterprise hardware space that has direct implications for us local AI nerds: Nvidia has rolled out new Simultaneous Multithreading (SMT) optimizations for their Vera CPU architecture via the Olympus platform firmware. Early reports and internal benchmarks are showing a consistent 3 to 6% performance gain across various workloads. ...