Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricLLM (Python CLI)KoboldCppJan
ScoreD49F38F34
Type
Executionhybridhybridhybrid
Interfacecliguigui
Cold Start500ms1500ms2000ms
Memory100MB400MB600MB
Startup100ms300ms400ms
Isolationprocessprocessprocess
Maturitystablestablestable
LanguagesPythonC++, PythonTypeScript, Python
LicenseApache-2.0AGPL-3.0AGPL-3.0
Links