Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricsafetensorsV8llama.cpp
ScoreA-83B74C+63
TypeLanguage
Executionaotjitaot
Interfaceembeddedembeddedcli
Cold Start<1ms5ms100ms
Memory0MB30MB50MB
Startup<1ms2ms10ms
Isolationprocessprocessprocess
Maturityproductionproductionproduction
LanguagesAnyJavaScript, TypeScript, WebAssemblyC, C++
LicenseApache-2.0BSD-3-ClauseMIT
Links