Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricwazeroExLlamaV2Open WebUI
ScoreA-81D47F41
TypeWebAssembly
Executionjitaothybrid
Interfacesdksdkgui
Cold Start1ms1000ms3000ms
Memory5MB300MB500MB
Startup<1ms200ms1000ms
Isolationprocessprocesscontainer
Maturitystablestablestable
LanguagesGoPython, C++, CUDAPython, TypeScript
LicenseApache-2.0MITMIT
Links