Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricsafetensorsBunExLlamaV2
ScoreA-83B+76D47
TypeLanguage
Executionaotjitaot
Interfaceembeddedclisdk
Cold Start<1ms3ms1000ms
Memory0MB25MB300MB
Startup<1ms1ms200ms
Isolationprocessprocessprocess
Maturityproductionstablestable
LanguagesAnyJavaScript, TypeScript, JSX, TSXPython, C++, CUDA
LicenseApache-2.0MITMIT
Links