Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricsafetensorsBunText Generation Inference
ScoreA-83B+76F39
TypeLanguage
Executionaotjithybrid
Interfaceembeddedcliapi
Cold Start<1ms3ms10000ms
Memory0MB25MB2000MB
Startup<1ms1ms5000ms
Isolationprocessprocesscontainer
Maturityproductionstableproduction
LanguagesAnyJavaScript, TypeScript, JSX, TSXRust, Python
LicenseApache-2.0MITApache-2.0
Links