Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricPython (CPython)Open WebUIText Generation InferencevLLM
ScoreB71F41F39F35
TypeLanguage
Executioninterpretedhybridhybridjit
Interfacecliguiapiapi
Cold Start50ms3000ms10000ms5000ms
Memory15MB500MB2000MB2000MB
Startup10ms1000ms5000ms3000ms
Isolationprocesscontainercontainerprocess
Maturityproductionstableproductionproduction
LanguagesPythonPython, TypeScriptRust, PythonPython
LicenseOtherMITApache-2.0Apache-2.0
Links