Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricwazeroVulkanExLlamaV2
ScoreA-81C+64D47
TypeWebAssembly
Executionjitaotaot
Interfacesdksdksdk
Cold Start1ms100ms1000ms
Memory5MB200MB300MB
Startup<1ms30ms200ms
Isolationprocesshardwareprocess
Maturitystableproductionstable
LanguagesGoC, C++Python, C++, CUDA
LicenseApache-2.0Apache-2.0MIT
Links