Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricMetalPython (CPython)DockerText Generation Inference
ScoreB74B71C-54F39
TypeLanguageContainer
Executionaotinterpretedhybridhybrid
Interfacesdkclicliapi
Cold Start50ms50ms500ms10000ms
Memory100MB15MB50MB2000MB
Startup20ms10ms200ms5000ms
Isolationhardwareprocesscontainercontainer
Maturityproductionproductionproductionproduction
LanguagesSwift, Objective-C, C++PythonAnyRust, Python
LicenseProprietaryOtherApache-2.0Apache-2.0
Links