Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricV8CUDA RuntimeDockerKoboldCpp
ScoreB74B-65C-54F38
TypeLanguageContainer
Executionjitaothybridhybrid
Interfaceembeddedsdkcligui
Cold Start5ms100ms500ms1500ms
Memory30MB500MB50MB400MB
Startup2ms50ms200ms300ms
Isolationprocesshardwarecontainerprocess
Maturityproductionproductionproductionstable
LanguagesJavaScript, TypeScript, WebAssemblyC, C++, PythonAnyC++, Python
LicenseBSD-3-ClauseProprietaryApache-2.0AGPL-3.0
Links