Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricPython (CPython)Text Generation InferenceJan
ScoreB71F39F34
TypeLanguage
Executioninterpretedhybridhybrid
Interfacecliapigui
Cold Start50ms10000ms2000ms
Memory15MB2000MB600MB
Startup10ms5000ms400ms
Isolationprocesscontainerprocess
Maturityproductionproductionstable
LanguagesPythonRust, PythonTypeScript, Python
LicenseOtherApache-2.0AGPL-3.0
Links