Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricwazeroExLlamaV2Jan
ScoreA-81D47F34
TypeWebAssembly
Executionjitaothybrid
Interfacesdksdkgui
Cold Start1ms1000ms2000ms
Memory5MB300MB600MB
Startup<1ms200ms400ms
Isolationprocessprocessprocess
Maturitystablestablestable
LanguagesGoPython, C++, CUDATypeScript, Python
LicenseApache-2.0MITAGPL-3.0
Links