Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricgVisorPython (CPython)DockerExLlamaV2
ScoreB72B71C-54D47
TypeMicroVMLanguageContainer
Executionhybridinterpretedhybridaot
Interfaceclicliclisdk
Cold Start50ms50ms500ms1000ms
Memory20MB15MB50MB300MB
Startup30ms10ms200ms200ms
Isolationmicrovmprocesscontainerprocess
Maturitystableproductionproductionstable
LanguagesAnyPythonAnyPython, C++, CUDA
LicenseApache-2.0OtherApache-2.0MIT
Links