🐕
RuntimeDog
Directory
AI Tools
Local LLM
Compare
AI Tools
AI launchers and inference engines for local LLM deployment.
Category:
All (25)
Tools (19)
Backends (4)
Formats (2)
📦
Runtimes
Role:
All
Launcher (2)
Engine (6)
Serving (2)
UI (6)
Interop (2)
Tool (1)
1 items
Name
Role
Type
Exec
Languages
Score
Cold Start
Memory
LLM (Python CLI)
Access large language models from the command-line
Tool
tool
hybrid
Python
D
500ms
100MB