Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricCUDA RuntimeNode.jsVulkanROCm
ScoreB-65B-65C+64C56
TypeLanguage
Executionaotjitaotaot
Interfacesdkclisdksdk
Cold Start100ms50ms100ms200ms
Memory500MB40MB200MB600MB
Startup50ms20ms30ms100ms
Isolationhardwareprocesshardwarehardware
Maturityproductionproductionproductionstable
LanguagesC, C++, PythonJavaScript, TypeScriptC, C++C, C++, Python
LicenseProprietaryMITApache-2.0MIT
Links