Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricMetalPython (CPython)Text Generation Inference
ScoreB74B71F39
TypeLanguage
Executionaotinterpretedhybrid
Interfacesdkcliapi
Cold Start50ms50ms10000ms
Memory100MB15MB2000MB
Startup20ms10ms5000ms
Isolationhardwareprocesscontainer
Maturityproductionproductionproduction
LanguagesSwift, Objective-C, C++PythonRust, Python
LicenseProprietaryOtherApache-2.0
Links