Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricsafetensorsPython (CPython)ROCm
ScoreA-83B71C56
TypeLanguage
Executionaotinterpretedaot
Interfaceembeddedclisdk
Cold Start<1ms50ms200ms
Memory0MB15MB600MB
Startup<1ms10ms100ms
Isolationprocessprocesshardware
Maturityproductionproductionstable
LanguagesAnyPythonC, C++, Python
LicenseApache-2.0OtherMIT
Links