Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricsafetensorswazeroKoboldCpp
ScoreA-83A-81F38
TypeWebAssembly
Executionaotjithybrid
Interfaceembeddedsdkgui
Cold Start<1ms1ms1500ms
Memory0MB5MB400MB
Startup<1ms<1ms300ms
Isolationprocessprocessprocess
Maturityproductionstablestable
LanguagesAnyGoC++, Python
LicenseApache-2.0Apache-2.0AGPL-3.0
Links