Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricBunPython (CPython)ExLlamaV2KoboldCpp
ScoreB+76B71D47F38
TypeLanguageLanguage
Executionjitinterpretedaothybrid
Interfacecliclisdkgui
Cold Start3ms50ms1000ms1500ms
Memory25MB15MB300MB400MB
Startup1ms10ms200ms300ms
Isolationprocessprocessprocessprocess
Maturitystableproductionstablestable
LanguagesJavaScript, TypeScript, JSX, TSXPythonPython, C++, CUDAC++, Python
LicenseMITOtherMITAGPL-3.0
Links