Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricOpen WebUIKoboldCppMLC LLM
ScoreF41F38F38
Type
Executionhybridhybridaot
Interfaceguiguisdk
Cold Start3000ms1500ms2000ms
Memory500MB400MB500MB
Startup1000ms300ms500ms
Isolationcontainerprocessprocess
Maturitystablestablestable
LanguagesPython, TypeScriptC++, PythonPython, C++
LicenseMITAGPL-3.0Apache-2.0
Links