Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricPython (CPython)CUDA RuntimeVulkanOllama
ScoreB71B-65C+64D49
TypeLanguage
Executioninterpretedaotaothybrid
Interfaceclisdksdkcli
Cold Start50ms100ms100ms1000ms
Memory15MB500MB200MB500MB
Startup10ms50ms30ms100ms
Isolationprocesshardwarehardwareprocess
Maturityproductionproductionproductionproduction
LanguagesPythonC, C++, PythonC, C++Python, JavaScript, Go
LicenseOtherProprietaryApache-2.0MIT
Links