Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricV8ROCmText Generation Inference
ScoreB74C56F39
TypeLanguage
Executionjitaothybrid
Interfaceembeddedsdkapi
Cold Start5ms200ms10000ms
Memory30MB600MB2000MB
Startup2ms100ms5000ms
Isolationprocesshardwarecontainer
Maturityproductionstableproduction
LanguagesJavaScript, TypeScript, WebAssemblyC, C++, PythonRust, Python
LicenseBSD-3-ClauseMITApache-2.0
Links