Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricNode.jsGoogle Cloud FunctionsText Generation InferenceKoboldCpp
ScoreB-65C59F39F38
TypeLanguageServerless
Executionjithybridhybridhybrid
Interfacecliplatformapigui
Cold Start50ms300ms10000ms1500ms
Memory40MB128MB2000MB400MB
Startup20ms50ms5000ms300ms
Isolationprocesscontainercontainerprocess
Maturityproductionproductionproductionstable
LanguagesJavaScript, TypeScriptPython, JavaScript, TypeScript, Go, Java, Ruby, PHPRust, PythonC++, Python
LicenseMITProprietaryApache-2.0AGPL-3.0
Links