Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricPython (CPython)ROCmLLM (Python CLI)Text Generation WebUI
ScoreB71C56D49F33
TypeLanguage
Executioninterpretedaothybridhybrid
Interfaceclisdkcligui
Cold Start50ms200ms500ms5000ms
Memory15MB600MB100MB1000MB
Startup10ms100ms100ms2000ms
Isolationprocesshardwareprocessprocess
Maturityproductionstablestablestable
LanguagesPythonC, C++, PythonPythonPython
LicenseOtherMITApache-2.0AGPL-3.0
Links