GPU and CPU backends for AI acceleration: CUDA, Metal, ROCm, Vulkan.
| Name | Role | Type | Exec | Languages | Score | Cold Start | Memory |
|---|---|---|---|---|---|---|---|
| Metal Apple's GPU framework for Apple Silicon acceleration | Backend | backend | aot | Swift, Objective-C, C++ | — | — | — |
| CUDA Runtime NVIDIA's parallel computing platform for GPU acceleration | Backend | backend | aot | C, C++, Python | — | — | — |
| Vulkan Cross-platform GPU API for compute and graphics | Backend | backend | aot | C, C++ | — | — | — |
| ROCm AMD's open-source GPU computing platform | Backend | backend | aot | C, C++, Python | — | — | — |