Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricGGUFBunLLM (Python CLI)
ScoreA-83B+76D49
TypeLanguage
Executionaotjithybrid
Interfaceembeddedclicli
Cold Start<1ms3ms500ms
Memory0MB25MB100MB
Startup<1ms1ms100ms
Isolationprocessprocessprocess
Maturityproductionstablestable
LanguagesAnyJavaScript, TypeScript, JSX, TSXPython
LicenseMITMITApache-2.0
Links