Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricGGUFPython (CPython)LLM (Python CLI)Jan
ScoreA-83B71D49F34
TypeLanguage
Executionaotinterpretedhybridhybrid
Interfaceembeddedclicligui
Cold Start<1ms50ms500ms2000ms
Memory0MB15MB100MB600MB
Startup<1ms10ms100ms400ms
Isolationprocessprocessprocessprocess
Maturityproductionproductionstablestable
LanguagesAnyPythonPythonTypeScript, Python
LicenseMITOtherApache-2.0AGPL-3.0
Links