Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricwazeroExLlamaV2CTransformers
ScoreA-81D47D46
TypeWebAssembly
Executionjitaothybrid
Interfacesdksdksdk
Cold Start1ms1000ms800ms
Memory5MB300MB200MB
Startup<1ms200ms100ms
Isolationprocessprocessprocess
Maturitystablestablestable
LanguagesGoPython, C++, CUDAPython, C++
LicenseApache-2.0MITMIT
Links