Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricOllamaCTransformersText Generation Inference
ScoreD49D46F39
Type
Executionhybridhybridhybrid
Interfaceclisdkapi
Cold Start1000ms800ms10000ms
Memory500MB200MB2000MB
Startup100ms100ms5000ms
Isolationprocessprocesscontainer
Maturityproductionstableproduction
LanguagesPython, JavaScript, GoPython, C++Rust, Python
LicenseMITMITApache-2.0
Links