Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricV8Text Generation InferenceLocalAI
ScoreB74F39F37
TypeLanguage
Executionjithybridhybrid
Interfaceembeddedapiapi
Cold Start5ms10000ms3000ms
Memory30MB2000MB800MB
Startup2ms5000ms1000ms
Isolationprocesscontainercontainer
Maturityproductionproductionstable
LanguagesJavaScript, TypeScript, WebAssemblyRust, PythonGo, Python
LicenseBSD-3-ClauseApache-2.0MIT
Links