Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricsafetensorsPython (CPython)containerdCUDA Runtime
ScoreA-83B71B-66B-65
TypeLanguageContainer
Executionaotinterpretedhybridaot
Interfaceembeddedcliplatformsdk
Cold Start<1ms50ms100ms100ms
Memory0MB15MB20MB500MB
Startup<1ms10ms20ms50ms
Isolationprocessprocesscontainerhardware
Maturityproductionproductionproductionproduction
LanguagesAnyPythonAnyC, C++, Python
LicenseApache-2.0OtherApache-2.0Proprietary
Links