Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricPython (CPython)Google Cloud FunctionsROCmLLM (Python CLI)KoboldCpp
ScoreB71C59C56D49F38
TypeLanguageServerless
Executioninterpretedhybridaothybridhybrid
Interfacecliplatformsdkcligui
Cold Start50ms300ms200ms500ms1500ms
Memory15MB128MB600MB100MB400MB
Startup10ms50ms100ms100ms300ms
Isolationprocesscontainerhardwareprocessprocess
Maturityproductionproductionstablestablestable
LanguagesPythonPython, JavaScript, TypeScript, Go, Java, Ruby, PHPC, C++, PythonPythonC++, Python
LicenseOtherProprietaryMITApache-2.0AGPL-3.0
Links