Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricText Generation InferenceText Generation WebUI
ScoreF39F33
Type
Executionhybridhybrid
Interfaceapigui
Cold Start10000ms5000ms
Memory2000MB1000MB
Startup5000ms2000ms
Isolationcontainerprocess
Maturityproductionstable
LanguagesRust, PythonPython
LicenseApache-2.0AGPL-3.0
Links