Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricGoogle Cloud FunctionsROCmLLM (Python CLI)KoboldCpp
ScoreC59C56D49F38
TypeServerless
Executionhybridaothybridhybrid
Interfaceplatformsdkcligui
Cold Start300ms200ms500ms1500ms
Memory128MB600MB100MB400MB
Startup50ms100ms100ms300ms
Isolationcontainerhardwareprocessprocess
Maturityproductionstablestablestable
LanguagesPython, JavaScript, TypeScript, Go, Java, Ruby, PHPC, C++, PythonPythonC++, Python
LicenseProprietaryMITApache-2.0AGPL-3.0
Links