Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricBunMetalPython (CPython)llama.cpp
ScoreB+76B74B71C+63
TypeLanguageLanguage
Executionjitaotinterpretedaot
Interfaceclisdkclicli
Cold Start3ms50ms50ms100ms
Memory25MB100MB15MB50MB
Startup1ms20ms10ms10ms
Isolationprocesshardwareprocessprocess
Maturitystableproductionproductionproduction
LanguagesJavaScript, TypeScript, JSX, TSXSwift, Objective-C, C++PythonC, C++
LicenseMITProprietaryOtherMIT
Links