unslothai/unsloth
GitHubLocal UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, Kimi K3, MiniMax-H3, Gemma 4, FLUX and more.
Teams whose requirements match this repository’s core capability.
Review deployment and security evidence before production adoption.
What matters before you adopt it
Security evidence without the noise
Trust remains a decision signal; CVEs and scanner evidence explain what is driving the risk.
View trust evidence & security findings▼
Architecture from code6 modules · 0 edges▼
Modules and dependency edges extracted from repository code. This is code evidence, not README inference.
Architecture evidence details
flowchart TD
%% unsloth — high-level architecture (DRAFT, refine me)
n0["(root) · 2 files"]
n1["attribution · 1 file"]
n2["scripts · scripts · 44 files"]
n3["studio · 3207 files"]
n4["tests · tests · 289 files"]
class n2 infra
class n4 test
classDef infra fill:#b35c00,color:#ffffff,stroke:#8f4a00
classDef test fill:#499894,color:#ffffff,stroke:#397975Nearby repositories worth comparing before adoption.
A high-throughput and memory-efficient inference and serving engine for LLMs
LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.
Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Agno, OpenAI Agents SDK, Langchain, Autogen, AG2, and CamelAI