Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricVulkanllama.cppOpen WebUI
ScoreC+64C+63F41
Type
Executionaotaothybrid
Interfacesdkcligui
Cold Start100ms100ms3000ms
Memory200MB50MB500MB
Startup30ms10ms1000ms
Isolationhardwareprocesscontainer
Maturityproductionproductionstable
LanguagesC, C++C, C++Python, TypeScript
LicenseApache-2.0MITMIT
Links