Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricsafetensorsNode.jsGoogle Cloud FunctionsKoboldCpp
ScoreA-83B-65C59F38
TypeLanguageServerless
Executionaotjithybridhybrid
Interfaceembeddedcliplatformgui
Cold Start<1ms50ms300ms1500ms
Memory0MB40MB128MB400MB
Startup<1ms20ms50ms300ms
Isolationprocessprocesscontainerprocess
Maturityproductionproductionproductionstable
LanguagesAnyJavaScript, TypeScriptPython, JavaScript, TypeScript, Go, Java, Ruby, PHPC++, Python
LicenseApache-2.0MITProprietaryAGPL-3.0
Links