Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricV8Python (CPython)Node.jsExLlamaV2KoboldCpp
ScoreB74B71B-65D47F38
TypeLanguageLanguageLanguage
Executionjitinterpretedjitaothybrid
Interfaceembeddedcliclisdkgui
Cold Start5ms50ms50ms1000ms1500ms
Memory30MB15MB40MB300MB400MB
Startup2ms10ms20ms200ms300ms
Isolationprocessprocessprocessprocessprocess
Maturityproductionproductionproductionstablestable
LanguagesJavaScript, TypeScript, WebAssemblyPythonJavaScript, TypeScriptPython, C++, CUDAC++, Python
LicenseBSD-3-ClauseOtherMITMITAGPL-3.0
Links