Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricWasmerPython (CPython)ExLlamaV2
ScoreA-83B71D47
TypeWebAssemblyLanguage
Executionhybridinterpretedaot
Interfacecliclisdk
Cold Start2ms50ms1000ms
Memory8MB15MB300MB
Startup1ms10ms200ms
Isolationprocessprocessprocess
Maturitystableproductionstable
LanguagesRust, C, C++, Go, Python, Ruby, PHPPythonPython, C++, CUDA
LicenseMITOtherMIT
Links