Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricV8Text Generation InferenceKoboldCpp
ScoreB74F39F38
TypeLanguage
Executionjithybridhybrid
Interfaceembeddedapigui
Cold Start5ms10000ms1500ms
Memory30MB2000MB400MB
Startup2ms5000ms300ms
Isolationprocesscontainerprocess
Maturityproductionproductionstable
LanguagesJavaScript, TypeScript, WebAssemblyRust, PythonC++, Python
LicenseBSD-3-ClauseApache-2.0AGPL-3.0
Links