Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricsafetensorsVulkanText Generation WebUI
ScoreA-83C+64F33
Type
Executionaotaothybrid
Interfaceembeddedsdkgui
Cold Start<1ms100ms5000ms
Memory0MB200MB1000MB
Startup<1ms30ms2000ms
Isolationprocesshardwareprocess
Maturityproductionproductionstable
LanguagesAnyC, C++Python
LicenseApache-2.0Apache-2.0AGPL-3.0
Links