Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricOllamaExLlamaV2CTransformers
ScoreD49D47D46
Type
Executionhybridaothybrid
Interfaceclisdksdk
Cold Start1000ms1000ms800ms
Memory500MB300MB200MB
Startup100ms200ms100ms
Isolationprocessprocessprocess
Maturityproductionstablestable
LanguagesPython, JavaScript, GoPython, C++, CUDAPython, C++
LicenseMITMITMIT
Links