Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricLLM (Python CLI)Open WebUIText Generation Inference
ScoreD49F41F39
Type
Executionhybridhybridhybrid
Interfacecliguiapi
Cold Start500ms3000ms10000ms
Memory100MB500MB2000MB
Startup100ms1000ms5000ms
Isolationprocesscontainercontainer
Maturitystablestableproduction
LanguagesPythonPython, TypeScriptRust, Python
LicenseApache-2.0MITApache-2.0
Links