Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricWasmercontainerdExLlamaV2
ScoreA-83B-66D47
TypeWebAssemblyContainer
Executionhybridhybridaot
Interfacecliplatformsdk
Cold Start2ms100ms1000ms
Memory8MB20MB300MB
Startup1ms20ms200ms
Isolationprocesscontainerprocess
Maturitystableproductionstable
LanguagesRust, C, C++, Go, Python, Ruby, PHPAnyPython, C++, CUDA
LicenseMITApache-2.0MIT
Links