Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricBunPython (CPython)KoboldCppMLC LLM
ScoreB+76B71F38F38
TypeLanguageLanguage
Executionjitinterpretedhybridaot
Interfaceclicliguisdk
Cold Start3ms50ms1500ms2000ms
Memory25MB15MB400MB500MB
Startup1ms10ms300ms500ms
Isolationprocessprocessprocessprocess
Maturitystableproductionstablestable
LanguagesJavaScript, TypeScript, JSX, TSXPythonC++, PythonPython, C++
LicenseMITOtherAGPL-3.0Apache-2.0
Links