Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricFirecrackerllama.cppvLLM
ScoreB70C+63F35
TypeMicroVM
Executionaotaotjit
Interfaceapicliapi
Cold Start125ms100ms5000ms
Memory5MB50MB2000MB
Startup100ms10ms3000ms
Isolationmicrovmprocessprocess
Maturityproductionproductionproduction
LanguagesAnyC, C++Python
LicenseApache-2.0MITApache-2.0
Links