Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricWasmtimesafetensorsPython (CPython)KoboldCpp
ScoreA88A-83B71F38
TypeWebAssemblyLanguage
Executionaotaotinterpretedhybrid
Interfacecliembeddedcligui
Cold Start1ms<1ms50ms1500ms
Memory5MB0MB15MB400MB
Startup<1ms<1ms10ms300ms
Isolationprocessprocessprocessprocess
Maturityproductionproductionproductionstable
LanguagesRust, C, C++, Go, Python, AssemblyScriptAnyPythonC++, Python
LicenseApache-2.0Apache-2.0OtherAGPL-3.0
Links