Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricgVisorLLM (Python CLI)ExLlamaV2
ScoreB72D49D47
TypeMicroVM
Executionhybridhybridaot
Interfacecliclisdk
Cold Start50ms500ms1000ms
Memory20MB100MB300MB
Startup30ms100ms200ms
Isolationmicrovmprocessprocess
Maturitystablestablestable
LanguagesAnyPythonPython, C++, CUDA
LicenseApache-2.0Apache-2.0MIT
Links