Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricwazeroExLlamaV2GPT4All
ScoreA-81D47F34
TypeWebAssembly
Executionjitaothybrid
Interfacesdksdkgui
Cold Start1ms1000ms2000ms
Memory5MB300MB600MB
Startup<1ms200ms500ms
Isolationprocessprocessprocess
Maturitystablestablestable
LanguagesGoPython, C++, CUDAC++, Python
LicenseApache-2.0MITMIT
Links