Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricPython (CPython)Open WebUIKoboldCppMLC LLM
ScoreB71F41F38F38
TypeLanguage
Executioninterpretedhybridhybridaot
Interfacecliguiguisdk
Cold Start50ms3000ms1500ms2000ms
Memory15MB500MB400MB500MB
Startup10ms1000ms300ms500ms
Isolationprocesscontainerprocessprocess
Maturityproductionstablestablestable
LanguagesPythonPython, TypeScriptC++, PythonPython, C++
LicenseOtherMITAGPL-3.0Apache-2.0
Links