A Portable LLM on a USB Stick: What Actually Works
Every guide to running AI from a USB drive points at an archived project and misses the one tool built for exactly this. Here is the working setup.
All articles tagged with “local-llm”
Every guide to running AI from a USB drive points at an archived project and misses the one tool built for exactly this. Here is the working setup.
Whisper's own table says 10GB of VRAM. The implementation most people install runs the same model in 3.9GB of ordinary memory. Here are the real numbers.
Liquid AI's LFM3 is a gigabyte-sized model claiming to do agentic work that needed 9B parameters. What its own benchmarks show, and the licence nobody quotes.
A model class that answers typed questions with probabilities instead of prose. The --ask flag, the three question types, which model to pull, and the limits.
Ollama added native speech generation on 24 October. How to get it talking, which checkpoint to pull, the licence trap, and what still returns a 400.
Everything you need to set up Ollama, pick the right model, and start running AI locally on your own hardware — no cloud, no API costs, full privacy.
How to wire up N8N workflows and a local Ollama model to research, write, and publish blog articles automatically — fully self-hosted, zero API costs.
A practical guide to building a working AI agent from scratch: a reasoning loop, tool definitions, and real tool execution — all running locally.
A hands-on review and setup guide for Open WebUI — the self-hosted chat interface that works with Ollama, LiteLLM, and any OpenAI-compatible endpoint.