Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricGGUFgVisorAWS LambdaKoboldCpp
ScoreA-83B72B-65F38
TypeMicroVMServerless
Executionaothybridhybridhybrid
Interfaceembeddedcliplatformgui
Cold Start<1ms50ms200ms1500ms
Memory0MB20MB128MB400MB
Startup<1ms30ms100ms300ms
Isolationprocessmicrovmmicrovmprocess
Maturityproductionstableproductionstable
LanguagesAnyAnyJavaScript, TypeScript, Python, Java, Go, Ruby, .NET, RustC++, Python
LicenseMITApache-2.0ProprietaryAGPL-3.0
Links