Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricPython (CPython)FirecrackerExLlamaV2CTransformers
ScoreB71B70D47D46
TypeLanguageMicroVM
Executioninterpretedaotaothybrid
Interfacecliapisdksdk
Cold Start50ms125ms1000ms800ms
Memory15MB5MB300MB200MB
Startup10ms100ms200ms100ms
Isolationprocessmicrovmprocessprocess
Maturityproductionproductionstablestable
LanguagesPythonAnyPython, C++, CUDAPython, C++
LicenseOtherApache-2.0MITMIT
Links