Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricsafetensorsBunText Generation WebUI
ScoreA-83B+76F33
TypeLanguage
Executionaotjithybrid
Interfaceembeddedcligui
Cold Start<1ms3ms5000ms
Memory0MB25MB1000MB
Startup<1ms1ms2000ms
Isolationprocessprocessprocess
Maturityproductionstablestable
LanguagesAnyJavaScript, TypeScript, JSX, TSXPython
LicenseApache-2.0MITAGPL-3.0
Links