Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricWasmerCUDA RuntimeExLlamaV2
ScoreA-83B-65D47
TypeWebAssembly
Executionhybridaotaot
Interfaceclisdksdk
Cold Start2ms100ms1000ms
Memory8MB500MB300MB
Startup1ms50ms200ms
Isolationprocesshardwareprocess
Maturitystableproductionstable
LanguagesRust, C, C++, Go, Python, Ruby, PHPC, C++, PythonPython, C++, CUDA
LicenseMITProprietaryMIT
Links