Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricPython (CPython)containerdONNX RuntimeText Generation WebUI
ScoreB71B-66C-50F33
TypeLanguageContainer
Executioninterpretedhybridhybridhybrid
Interfacecliplatformsdkgui
Cold Start50ms100ms500ms5000ms
Memory15MB20MB300MB1000MB
Startup10ms20ms100ms2000ms
Isolationprocesscontainerprocessprocess
Maturityproductionproductionproductionstable
LanguagesPythonAnyPython, C++, C#, JavaPython
LicenseOtherApache-2.0MITAGPL-3.0
Links