Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricLLM (Python CLI)KoboldCppText Generation WebUI
ScoreD49F38F33
Type
Executionhybridhybridhybrid
Interfacecliguigui
Cold Start500ms1500ms5000ms
Memory100MB400MB1000MB
Startup100ms300ms2000ms
Isolationprocessprocessprocess
Maturitystablestablestable
LanguagesPythonC++, PythonPython
LicenseApache-2.0AGPL-3.0AGPL-3.0
Links