Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricWasmerDockerExLlamaV2
ScoreA-83C-54D47
TypeWebAssemblyContainer
Executionhybridhybridaot
Interfacecliclisdk
Cold Start2ms500ms1000ms
Memory8MB50MB300MB
Startup1ms200ms200ms
Isolationprocesscontainerprocess
Maturitystableproductionstable
LanguagesRust, C, C++, Go, Python, Ruby, PHPAnyPython, C++, CUDA
LicenseMITApache-2.0MIT
Links