Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricsafetensorsPython (CPython)Text Generation WebUI
ScoreA-83B71F33
TypeLanguage
Executionaotinterpretedhybrid
Interfaceembeddedcligui
Cold Start<1ms50ms5000ms
Memory0MB15MB1000MB
Startup<1ms10ms2000ms
Isolationprocessprocessprocess
Maturityproductionproductionstable
LanguagesAnyPythonPython
LicenseApache-2.0OtherAGPL-3.0
Links