Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricVulkanllamafileLLM (Python CLI)
ScoreC+64C-53D49
Type
Executionaotaothybrid
Interfacesdkclicli
Cold Start100ms500ms500ms
Memory200MB100MB100MB
Startup30ms50ms100ms
Isolationhardwareprocessprocess
Maturityproductionstablestable
LanguagesC, C++C, C++Python
LicenseApache-2.0Apache-2.0Apache-2.0
Links