Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricGGUFPython (CPython)Vulkan
ScoreA-83B71C+64
TypeLanguage
Executionaotinterpretedaot
Interfaceembeddedclisdk
Cold Start<1ms50ms100ms
Memory0MB15MB200MB
Startup<1ms10ms30ms
Isolationprocessprocesshardware
Maturityproductionproductionproduction
LanguagesAnyPythonC, C++
LicenseMITOtherApache-2.0
Links