Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricPython (CPython)Firecrackerllama.cppMLC LLM
ScoreB71B70C+63F38
TypeLanguageMicroVM
Executioninterpretedaotaotaot
Interfacecliapiclisdk
Cold Start50ms125ms100ms2000ms
Memory15MB5MB50MB500MB
Startup10ms100ms10ms500ms
Isolationprocessmicrovmprocessprocess
Maturityproductionproductionproductionstable
LanguagesPythonAnyC, C++Python, C++
LicenseOtherApache-2.0MITApache-2.0
Links