Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricNode.jsDockerllamafileKoboldCpp
ScoreB-65C-54C-53F38
TypeLanguageContainer
Executionjithybridaothybrid
Interfacecliclicligui
Cold Start50ms500ms500ms1500ms
Memory40MB50MB100MB400MB
Startup20ms200ms50ms300ms
Isolationprocesscontainerprocessprocess
Maturityproductionproductionstablestable
LanguagesJavaScript, TypeScriptAnyC, C++C++, Python
LicenseMITApache-2.0Apache-2.0AGPL-3.0
Links