All articles

Local LLMs

3 articles

Run AI models on your own hardware. Guides for Ollama, LM Studio, and self-hosted inference — no cloud, no API costs.

Running a language model on your own machine changes the economics of everything built on top of it. There is no per-token bill, no rate limit, no request leaving your network, and no vendor deprecating the model you built a workflow around. The trade is that you own the setup: picking a model that fits your VRAM, quantizing it so it actually runs, and accepting that a 7B model on a laptop is not going to match a frontier API on reasoning-heavy work.

These guides cover the practical end of that — installing and running Ollama, picking between model families and quantization levels, putting a usable interface in front of a local model, and deciding which jobs are worth keeping local versus sending to an API. Every benchmark and hardware note here comes from a Ryzen 7 5800HS with 16GB of RAM and a GTX 1650, which is deliberately unremarkable hardware. If a workflow runs there, it runs on most things.

Start with the Ollama guide if you have never run a local model, then move to Open WebUI once you want something you can actually hand to someone else.