🐕RuntimeDog
🏠

Local LLM Hub

Run LLMs on your own hardware. Find the right launcher, engine, and configuration for your setup.

NVIDIA-first. Mac-strong. Pick your GPU, get your stack.

🟢 NVIDIA🍎 Mac💻 CPU Only🔴 AMD

Quick Start: AMD (16GB VRAM (RX 7900 XT))

Beginnergguf
ollama + llama.cpp
Quant: Q4_K_M to Q5_K_M
ROCm supported. Setup more complex than NVIDIA
Powergguf
text-generation-webui + llama.cpp
Quant: Q5_K_M
ROCm environment setup required
→ Find your exact stack→ See all AMD configurations
Filter by role:AllLauncher (8)Engine (10)Format (2)Backend (4)Tool (1)
1 local LLM tools
NameRoleBackendsFormatsScoreInstall
LLM (Python CLI)
Access large language models from the command-line
Toolcuda, metal, cpugguf52 (C-)🍎🐧