Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricFirecrackerExLlamaV2Open WebUI
ScoreB70D47F41
TypeMicroVM
Executionaotaothybrid
Interfaceapisdkgui
Cold Start125ms1000ms3000ms
Memory5MB300MB500MB
Startup100ms200ms1000ms
Isolationmicrovmprocesscontainer
Maturityproductionstablestable
LanguagesAnyPython, C++, CUDAPython, TypeScript
LicenseApache-2.0MITMIT
Links