Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricBunPython (CPython)LLM (Python CLI)ExLlamaV2
ScoreB+76B71D49D47
TypeLanguageLanguage
Executionjitinterpretedhybridaot
Interfaceclicliclisdk
Cold Start3ms50ms500ms1000ms
Memory25MB15MB100MB300MB
Startup1ms10ms100ms200ms
Isolationprocessprocessprocessprocess
Maturitystableproductionstablestable
LanguagesJavaScript, TypeScript, JSX, TSXPythonPythonPython, C++, CUDA
LicenseMITOtherApache-2.0MIT
Links