Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricPython (CPython)Text Generation InferenceText Generation WebUI
ScoreB71F39F33
TypeLanguage
Executioninterpretedhybridhybrid
Interfacecliapigui
Cold Start50ms10000ms5000ms
Memory15MB2000MB1000MB
Startup10ms5000ms2000ms
Isolationprocesscontainerprocess
Maturityproductionproductionstable
LanguagesPythonRust, PythonPython
LicenseOtherApache-2.0AGPL-3.0
Links