Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetriccontainerdNode.jsROCmKoboldCpp
ScoreB-66B-65C56F38
TypeContainerLanguage
Executionhybridjitaothybrid
Interfaceplatformclisdkgui
Cold Start100ms50ms200ms1500ms
Memory20MB40MB600MB400MB
Startup20ms20ms100ms300ms
Isolationcontainerprocesshardwareprocess
Maturityproductionproductionstablestable
LanguagesAnyJavaScript, TypeScriptC, C++, PythonC++, Python
LicenseApache-2.0MITMITAGPL-3.0
Links