Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricPython (CPython)VulkanllamafileOllama
ScoreB71C+64C-53D49
TypeLanguage
Executioninterpretedaotaothybrid
Interfaceclisdkclicli
Cold Start50ms100ms500ms1000ms
Memory15MB200MB100MB500MB
Startup10ms30ms50ms100ms
Isolationprocesshardwareprocessprocess
Maturityproductionproductionstableproduction
LanguagesPythonC, C++C, C++Python, JavaScript, Go
LicenseOtherApache-2.0Apache-2.0MIT
Links