Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricWasmerROCmExLlamaV2
ScoreA-83C56D47
TypeWebAssembly
Executionhybridaotaot
Interfaceclisdksdk
Cold Start2ms200ms1000ms
Memory8MB600MB300MB
Startup1ms100ms200ms
Isolationprocesshardwareprocess
Maturitystablestablestable
LanguagesRust, C, C++, Go, Python, Ruby, PHPC, C++, PythonPython, C++, CUDA
LicenseMITMITMIT
Links