Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricLLM (Python CLI)OllamaKoboldCppJan
ScoreD49D49F38F34
Type
Executionhybridhybridhybridhybrid
Interfaceclicliguigui
Cold Start500ms1000ms1500ms2000ms
Memory100MB500MB400MB600MB
Startup100ms100ms300ms400ms
Isolationprocessprocessprocessprocess
Maturitystableproductionstablestable
LanguagesPythonPython, JavaScript, GoC++, PythonTypeScript, Python
LicenseApache-2.0MITAGPL-3.0AGPL-3.0
Links