AI launchers and inference engines for local LLM deployment.
| Name | Role | Type | Exec | Languages | Score | Cold Start | Memory |
|---|---|---|---|---|---|---|---|
| Open WebUI User-friendly WebUI for LLMs with Ollama/OpenAI support | UI | launcher | hybrid | Python, TypeScript | F | 3000ms | 500MB |
| KoboldCpp Easy-to-use AI text generation with llama.cpp backend | UI | launcher | hybrid | C++, Python | F | 1500ms | 400MB |
| GPT4All Free-to-use, locally running, privacy-aware chatbot | UI | launcher | hybrid | C++, Python | F | 2000ms | 600MB |
| Jan Open-source ChatGPT alternative that runs offline | UI | launcher | hybrid | TypeScript, Python | F | 2000ms | 600MB |
| LM Studio Discover, download, and run local LLMs with a beautiful GUI | UI | launcher | hybrid | Python | F | 2000ms | 800MB |
| Text Generation WebUI Gradio web UI for running Large Language Models | UI | launcher | hybrid | Python | F | 5000ms | 1000MB |