Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricPython (CPython)containerdVulkanllama.cpp
ScoreB71B-66C+64C+63
TypeLanguageContainer
Executioninterpretedhybridaotaot
Interfacecliplatformsdkcli
Cold Start50ms100ms100ms100ms
Memory15MB20MB200MB50MB
Startup10ms20ms30ms10ms
Isolationprocesscontainerhardwareprocess
Maturityproductionproductionproductionproduction
LanguagesPythonAnyC, C++C, C++
LicenseOtherApache-2.0Apache-2.0MIT
Links