LLM Guides

Guides for running large language models locally. From your first ollama pull to multi-model setups with GPU optimization.

Guides

(More coming soon — we’re building this site out live.)

Quantization Explained: GGUF, Q4, Q8, and Why It Matters

Q4 vs Q8 vs F16 — what do these numbers mean, and why does your model size change so drastically? A beginner-friendly guide to quantization and GGUF format for local LLMs.

Choosing Your First Local LLM Model: A Beginner's Guide

Llama, GLM, Qwen, Mistral — what’s the difference, what fits your GPU, and which one should you run first? A practical beginner’s guide to choosing a local LLM.

Ollama vs LM Studio: Which Should You Choose?

Ollama vs LM Studio — features, performance, and which one to pick for your setup.

Run Local AI with No GPU: It's Easier Than You Think

No GPU? No problem. Run local LLMs on CPU with Ollama and llama.cpp — setup, performance expectations, and optimization tips.

Guides#

Guides