Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricMetalPython (CPython)containerdllama.cpp
ScoreB74B71B-66C+63
TypeLanguageContainer
Executionaotinterpretedhybridaot
Interfacesdkcliplatformcli
Cold Start50ms50ms100ms100ms
Memory100MB15MB20MB50MB
Startup20ms10ms20ms10ms
Isolationhardwareprocesscontainerprocess
Maturityproductionproductionproductionproduction
LanguagesSwift, Objective-C, C++PythonAnyC, C++
LicenseProprietaryOtherApache-2.0MIT
Links