Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricPython (CPython)CUDA RuntimeNode.jsllama.cppAzure FunctionsDocker
ScoreB71B-65B-65C+63C56C-54
TypeLanguageLanguageServerlessContainer
Executioninterpretedaotjitaothybridhybrid
Interfaceclisdkclicliplatformcli
Cold Start50ms100ms50ms100ms800ms500ms
Memory15MB500MB40MB50MB128MB50MB
Startup10ms50ms20ms10ms100ms200ms
Isolationprocesshardwareprocessprocesscontainercontainer
Maturityproductionproductionproductionproductionproductionproduction
LanguagesPythonC, C++, PythonJavaScript, TypeScriptC, C++JavaScript, TypeScript, Python, Java, C#, PowerShell, GoAny
LicenseOtherProprietaryMITMITMITApache-2.0
Links