Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricV8CUDA RuntimeText Generation Inference
ScoreB74B-65F39
TypeLanguage
Executionjitaothybrid
Interfaceembeddedsdkapi
Cold Start5ms100ms10000ms
Memory30MB500MB2000MB
Startup2ms50ms5000ms
Isolationprocesshardwarecontainer
Maturityproductionproductionproduction
LanguagesJavaScript, TypeScript, WebAssemblyC, C++, PythonRust, Python
LicenseBSD-3-ClauseProprietaryApache-2.0
Links