Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricwazeroCUDA RuntimeText Generation Inference
ScoreA-81B-65F39
TypeWebAssembly
Executionjitaothybrid
Interfacesdksdkapi
Cold Start1ms100ms10000ms
Memory5MB500MB2000MB
Startup<1ms50ms5000ms
Isolationprocesshardwarecontainer
Maturitystableproductionproduction
LanguagesGoC, C++, PythonRust, Python
LicenseApache-2.0ProprietaryApache-2.0
Links