Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricgVisorPython (CPython)Text Generation InferenceKoboldCpp
ScoreB72B71F39F38
TypeMicroVMLanguage
Executionhybridinterpretedhybridhybrid
Interfaceclicliapigui
Cold Start50ms50ms10000ms1500ms
Memory20MB15MB2000MB400MB
Startup30ms10ms5000ms300ms
Isolationmicrovmprocesscontainerprocess
Maturitystableproductionproductionstable
LanguagesAnyPythonRust, PythonC++, Python
LicenseApache-2.0OtherApache-2.0AGPL-3.0
Links