Skip to main content
Local LLM Guide

About Local LLM Guide

Local LLM Guide helps people choose and run AI models on their own computers. The site is built around one practical question: what setup should I use on this machine for this job?

What the site does

The tools help you match your computer, model size, app, and task. The guides cover installation, troubleshooting, document workflows, privacy, and the handful of concepts that actually change a decision.

Start with the computer you already own and one task you want help with. For example, you might want to summarize a short PDF, rewrite a draft, or ask questions without sending them to a cloud service.

Editor: Jack

How to use it

Start with a decision, not a catalog.

Check your hardware

Find a starting model size and app for the machine you already own.

Choose an app

Choose an app for everyday chat, document questions, or connecting AI to another program.

Follow one setup path

Get one successful response before adding documents, automated tasks, or larger conversations.

Fix the exact failure

Diagnose memory, speed, GPU, connection, download, document, and privacy problems by symptom.

How to use the recommendations

Each recommendation explains what to try and what could change the answer. For example, a model that fits in memory for a short chat may need more memory when you add a long document.

Use the model and software lists when you want to compare more options. If you are just starting, follow a setup guide and try a small model first.

How recommendations work →

Explore models, hardware, and apps

Models Hardware Apps and runtimes

Open-source software notices