Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricLLM (Python CLI)CTransformersText Generation WebUI
ScoreD49D46F33
Type
Executionhybridhybridhybrid
Interfaceclisdkgui
Cold Start500ms800ms5000ms
Memory100MB200MB1000MB
Startup100ms100ms2000ms
Isolationprocessprocessprocess
Maturitystablestablestable
LanguagesPythonPython, C++Python
LicenseApache-2.0MITAGPL-3.0
Links