Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricGoogle Cloud FunctionsText Generation InferenceKoboldCpp
ScoreC59F39F38
TypeServerless
Executionhybridhybridhybrid
Interfaceplatformapigui
Cold Start300ms10000ms1500ms
Memory128MB2000MB400MB
Startup50ms5000ms300ms
Isolationcontainercontainerprocess
Maturityproductionproductionstable
LanguagesPython, JavaScript, TypeScript, Go, Java, Ruby, PHPRust, PythonC++, Python
LicenseProprietaryApache-2.0AGPL-3.0
Links