mudler/LocalAI
GitHubLocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.
Teams whose requirements match this repository’s core capability.
Review deployment and security evidence before production adoption.
What matters before you adopt it
Security evidence without the noise
Trust remains a decision signal; CVEs and scanner evidence explain what is driving the risk.
View trust evidence & security findings▼
Architecture from code47 modules · 0 edges▼
Modules and dependency edges extracted from repository code. This is code evidence, not README inference.
Architecture evidence details
flowchart TD
%% repo — high-level architecture (DRAFT, refine me)
n0["backend · backend · 102 files"]
n1["core · core utilities · 313 files"]
n2["examples · examples · 1 file"]
n3["scripts · scripts · 5 files"]
n4["tests · tests · 1 file"]
n5["website · 1 file"]
class n0 api
class n1 core
class n2 docs
class n3 infra
class n4 test
classDef api fill:#af7aa1,color:#ffffff,stroke:#8a5f7f
classDef core fill:#e15759,color:#ffffff,stroke:#b04547
classDef docs fill:#9d7660,color:#ffffff,stroke:#7c5d4c
classDef infra fill:#b35c00,color:#ffffff,stroke:#8f4a00
classDef test fill:#499894,color:#ffffff,stroke:#397975Nearby repositories worth comparing before adoption.
Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, Kimi K3, MiniMax-H3, Gemma 4, FLUX and more.
A high-throughput and memory-efficient inference and serving engine for LLMs
One SQL interface for 60+ tools (e.g., GitHub, Notion, Airtable). Plug into any LLM through MCP.