Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricDockerKoboldCppText Generation WebUI
ScoreC-54F38F33
TypeContainer
Executionhybridhybridhybrid
Interfacecliguigui
Cold Start500ms1500ms5000ms
Memory50MB400MB1000MB
Startup200ms300ms2000ms
Isolationcontainerprocessprocess
Maturityproductionstablestable
LanguagesAnyC++, PythonPython
LicenseApache-2.0AGPL-3.0AGPL-3.0
Links