Tutorials

Step-by-step tutorials for real self-hosted AI projects. Each tutorial is tested on our actual infrastructure.

Tutorials

(More coming soon — we’re building this site out live.)

Yandex Outage: Data Shows That Instead Of Going Dark, Malicious Bots Went On The Move

Yandex Outage: Data Shows That Instead Of Going Dark, Malicious Bots Went On The Move Hey folks, welcome back to Self-Hosted Tech. If you’ve been running a homelab or self-hosting your applications for any amount of time, you know that the internet is a noisy place. Your logs are constantly filling up with random requests from unknown IP addresses trying to log into your SSH server, hit your admin panels, or exploit vulnerabilities you didn’t even know existed. ...

Yandex Outage: Data Shows That Instead Of Going Dark, Malicious Bots Moved

Yandex Outage: Data Shows That Instead Of Going Dark, Malicious Bots Moved Welcome back to Self-Hosted Tech. If you’ve been running a homelab or self-hosting your applications for any amount of time, you already know that the internet is a constant, invisible warzone. Every second, automated scripts are scanning IP addresses, probing ports, and trying to brute-force their way into your Nextcloud, Vaultwarden, or Home Assistant instances. ...

Intel Xeon 6980P Granite Rapids Performance On Linux Over The Past Year

Intel Xeon 6980P Granite Rapids Performance On Linux Over The Past Year Hey folks, welcome back to Self-Hosted Tech. If you’ve been following the channel or the blog for a while, you know we love pushing enterprise hardware to its absolute limits in our home labs. Today, we’re taking a deep dive into an absolute monster of a processor: the Intel Xeon 6980P, part of the Granite Rapids family. Over the past year, we’ve watched the Linux kernel and the open-source ecosystem evolve to fully support this silicon. Granite Rapids isn’t just another CPU with more cores; it represents a massive architectural shift aimed squarely at the local AI and heavy virtualization markets. ...

Inside Hyperdrive: How We Solved A Rare Hyperdrive Mysql Caching Bug

Inside Hyperdrive: How We Solved A Rare Hyperdrive MySQL Caching Bug If you’ve been following the self-hosting scene for a while, you know that the dream is simple: run your own services, own your data, and keep latency low. Cloudflare’s Hyperdrive has been a game-changer for a lot of us in that regard. It pools database connections and caches query results at the edge, which means your self-hosted MySQL database sitting in a closet at home can suddenly feel like it’s running in a data center across the street. ...

Under The Hood, Off The Hot Path: How D1 Scales To Millions Of Databases

Under The Hood, Off The Hot Path: How D1 Scales To Millions Of Databases Welcome back to Self-Hosted Tech! If you’ve been running a homelab for any amount of time, you already know that databases are the beating heart of almost every application we deploy. Whether you’re spinning up Nextcloud, tracking your smart home metrics in Home Assistant, or building a custom wrapper for your local LLMs, you need somewhere to store that data. ...

Run local AI with no GPU

Run Local AI with No GPU: Your CPU Is All You Need If you’ve been following the explosion of AI over the last couple of years, you might be under the impression that to run your own large language models (LLMs) locally, you need a massive, $2,000+ graphics card with 24GB of VRAM. Well, I’m here to let you in on a little secret: the GPU cartels want you to think that, but it’s simply not true. ...

ComfyUI setup guide for beginners

ComfyUI Setup Guide for Beginners: Unleash Local AI Image Generation Welcome back to Self-Hosted Tech! If you’ve been hanging around the homelab and local AI communities lately, you’ve probably heard the name “Stable Diffusion” thrown around a lot. And if you’ve looked into running Stable Diffusion locally, you’ve undoubtedly seen screenshots of ComfyUI—a dizzying array of boxes and lines that looks like a hacker’s conspiracy board. ...

Quantization explained: making LLMs fit your GPU

Quantization Explained: Making LLMs Fit Your GPU If you’ve spent any time in the homelab or local AI space recently, you’ve probably run into the same frustrating wall we all do. You read about an amazing new open-source Large Language Model (LLM) like Llama 3 or Mistral. You excitedly fire up your terminal, download the model, hit “Run,” and then… boom. CUDA out of memory. Tried to allocate 2.00 GiB... ...

What is MoE (Mixture of Experts) in LLMs?

What is MoE (Mixture of Experts) in LLMs? If you’ve been hanging out in the local AI and self-hosting communities for the last few months, you’ve probably heard the term “MoE” thrown around. Maybe you saw someone on Reddit raving about Mixtral, or you saw a new model release on Hugging Face touting “Mixture of Experts” architecture. ...

How I Used Guilt As A Motivator For Good

How I Used Guilt As A Motivator For Good If you’re reading this on the Self-Hosted Tech blog, I can safely assume a few things about you. You probably have a stack of hard drives somewhere in your house. You likely have a dusty Raspberry Pi or two in a drawer. And, if you’re anything like me, you have a creeping, persistent sense of guilt about the hardware you’ve bought, provisioned, and then left to sit idle. ...

Tutorials#

Tutorials