Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricgVisorPython (CPython)llama.cppOpen WebUIKoboldCpp
ScoreB72B71C+63F41F38
TypeMicroVMLanguage
Executionhybridinterpretedaothybridhybrid
Interfacecliclicliguigui
Cold Start50ms50ms100ms3000ms1500ms
Memory20MB15MB50MB500MB400MB
Startup30ms10ms10ms1000ms300ms
Isolationmicrovmprocessprocesscontainerprocess
Maturitystableproductionproductionstablestable
LanguagesAnyPythonC, C++Python, TypeScriptC++, Python
LicenseApache-2.0OtherMITMITAGPL-3.0
Links