Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricVulkanOpen WebUIKoboldCpp
ScoreC+64F41F38
Type
Executionaothybridhybrid
Interfacesdkguigui
Cold Start100ms3000ms1500ms
Memory200MB500MB400MB
Startup30ms1000ms300ms
Isolationhardwarecontainerprocess
Maturityproductionstablestable
LanguagesC, C++Python, TypeScriptC++, Python
LicenseApache-2.0MITAGPL-3.0
Links