Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricPython (CPython)Azure FunctionsText Generation InferenceKoboldCpp
ScoreB71C56F39F38
TypeLanguageServerless
Executioninterpretedhybridhybridhybrid
Interfacecliplatformapigui
Cold Start50ms800ms10000ms1500ms
Memory15MB128MB2000MB400MB
Startup10ms100ms5000ms300ms
Isolationprocesscontainercontainerprocess
Maturityproductionproductionproductionstable
LanguagesPythonJavaScript, TypeScript, Python, Java, C#, PowerShell, GoRust, PythonC++, Python
LicenseOtherMITApache-2.0AGPL-3.0
Links