Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricLLM (Python CLI)Open WebUIKoboldCpp
ScoreD49F41F38
Type
Executionhybridhybridhybrid
Interfacecliguigui
Cold Start500ms3000ms1500ms
Memory100MB500MB400MB
Startup100ms1000ms300ms
Isolationprocesscontainerprocess
Maturitystablestablestable
LanguagesPythonPython, TypeScriptC++, Python
LicenseApache-2.0MITAGPL-3.0
Links