Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricBunLLM (Python CLI)ExLlamaV2
ScoreB+76D49D47
TypeLanguage
Executionjithybridaot
Interfacecliclisdk
Cold Start3ms500ms1000ms
Memory25MB100MB300MB
Startup1ms100ms200ms
Isolationprocessprocessprocess
Maturitystablestablestable
LanguagesJavaScript, TypeScript, JSX, TSXPythonPython, C++, CUDA
LicenseMITApache-2.0MIT
Links