Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricAzure FunctionsText Generation InferenceMLC LLM
ScoreC56F39F38
TypeServerless
Executionhybridhybridaot
Interfaceplatformapisdk
Cold Start800ms10000ms2000ms
Memory128MB2000MB500MB
Startup100ms5000ms500ms
Isolationcontainercontainerprocess
Maturityproductionproductionstable
LanguagesJavaScript, TypeScript, Python, Java, C#, PowerShell, GoRust, PythonPython, C++
LicenseMITApache-2.0Apache-2.0
Links