Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricMetalPython (CPython)ROCmLLM (Python CLI)
ScoreB74B71C56D49
TypeLanguage
Executionaotinterpretedaothybrid
Interfacesdkclisdkcli
Cold Start50ms50ms200ms500ms
Memory100MB15MB600MB100MB
Startup20ms10ms100ms100ms
Isolationhardwareprocesshardwareprocess
Maturityproductionproductionstablestable
LanguagesSwift, Objective-C, C++PythonC, C++, PythonPython
LicenseProprietaryOtherMITApache-2.0
Links