Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricPython (CPython)Node.jsROCmOllamaText Generation Inference
ScoreB71B-65C56D49F39
TypeLanguageLanguage
Executioninterpretedjitaothybridhybrid
Interfacecliclisdkcliapi
Cold Start50ms50ms200ms1000ms10000ms
Memory15MB40MB600MB500MB2000MB
Startup10ms20ms100ms100ms5000ms
Isolationprocessprocesshardwareprocesscontainer
Maturityproductionproductionstableproductionproduction
LanguagesPythonJavaScript, TypeScriptC, C++, PythonPython, JavaScript, GoRust, Python
LicenseOtherMITMITMITApache-2.0
Links