LocalAI

Free, open-source OpenAI alternative with local inference

F
Score: 37/100
Type
Execution
hybrid
Interface
api

About

LocalAI is a free, open-source OpenAI-compatible API that runs locally. It supports llama.cpp, whisper.cpp, and other backends. Drop-in replacement for OpenAI API, supporting text generation, embeddings, audio transcription, and image generation.

Performance

3000ms
Cold Start
800MB
Base Memory
1000ms
Startup Overhead

Last Verified

Date: Jan 18, 2026
Method: manual test

Manually verified

Languages

GoPython

Details

Isolation
container
Maturity
stable
License
MIT

Links