Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricPython (CPython)VulkanONNX RuntimeOllama
ScoreB71C+64C-50D49
TypeLanguage
Executioninterpretedaothybridhybrid
Interfaceclisdksdkcli
Cold Start50ms100ms500ms1000ms
Memory15MB200MB300MB500MB
Startup10ms30ms100ms100ms
Isolationprocesshardwareprocessprocess
Maturityproductionproductionproductionproduction
LanguagesPythonC, C++Python, C++, C#, JavaPython, JavaScript, Go
LicenseOtherApache-2.0MITMIT
Links