Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricFirecrackerllama.cppText Generation WebUI
ScoreB70C+63F33
TypeMicroVM
Executionaotaothybrid
Interfaceapicligui
Cold Start125ms100ms5000ms
Memory5MB50MB1000MB
Startup100ms10ms2000ms
Isolationmicrovmprocessprocess
Maturityproductionproductionstable
LanguagesAnyC, C++Python
LicenseApache-2.0MITAGPL-3.0
Links