Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricOllamaKoboldCppText Generation WebUI
ScoreD49F38F33
Type
Executionhybridhybridhybrid
Interfacecliguigui
Cold Start1000ms1500ms5000ms
Memory500MB400MB1000MB
Startup100ms300ms2000ms
Isolationprocessprocessprocess
Maturityproductionstablestable
LanguagesPython, JavaScript, GoC++, PythonPython
LicenseMITAGPL-3.0AGPL-3.0
Links