Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricsafetensorsV8Python (CPython)llama.cpp
ScoreA-83B74B71C+63
TypeLanguageLanguage
Executionaotjitinterpretedaot
Interfaceembeddedembeddedclicli
Cold Start<1ms5ms50ms100ms
Memory0MB30MB15MB50MB
Startup<1ms2ms10ms10ms
Isolationprocessprocessprocessprocess
Maturityproductionproductionproductionproduction
LanguagesAnyJavaScript, TypeScript, WebAssemblyPythonC, C++
LicenseApache-2.0BSD-3-ClauseOtherMIT
Links