Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricGGUFPython (CPython)AWS LambdaNode.jsDockerLLM (Python CLI)
ScoreA-83B71B-65B-65C-54D49
TypeLanguageServerlessLanguageContainer
Executionaotinterpretedhybridjithybridhybrid
Interfaceembeddedcliplatformcliclicli
Cold Start<1ms50ms200ms50ms500ms500ms
Memory0MB15MB128MB40MB50MB100MB
Startup<1ms10ms100ms20ms200ms100ms
Isolationprocessprocessmicrovmprocesscontainerprocess
Maturityproductionproductionproductionproductionproductionstable
LanguagesAnyPythonJavaScript, TypeScript, Python, Java, Go, Ruby, .NET, RustJavaScript, TypeScriptAnyPython
LicenseMITOtherProprietaryMITApache-2.0Apache-2.0
Links