Reading the repo
Opening the box…
Reading the repo
Opening the box…
How to install on Linux
LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.
Saved setup from 11 h ago
Will it work on Linux?
Also: In the browser ↗
curl -LO "https://github.com/mudler/LocalAI/releases/download/v4.12.1/LocalAI-Launcher-x86_64.AppImage" chmod +x "LocalAI-Launcher-x86_64.AppImage" ./"LocalAI-Launcher-x86_64.AppImage"
curl -LO "https://github.com/mudler/LocalAI/releases/download/v4.12.1/local-ai-launcher-linux.tar.xz" tar -xJf "local-ai-launcher-linux.tar.xz"
curl -LO "https://github.com/mudler/LocalAI/releases/download/v4.12.1/local-ai-v4.12.1-linux-amd64" chmod +x "local-ai-v4.12.1-linux-amd64"
curl -LO "https://github.com/mudler/LocalAI/releases/download/v4.12.1/local-ai-v4.12.1-linux-arm64" chmod +x "local-ai-v4.12.1-linux-arm64"
A self-hosted app: Docker runs it on your computer and you open it in the browser. Needs Docker Desktop (or Docker Engine on Linux). Run docker compose commands inside the cloned repo folder.
docker run -ti --name local-ai -p 8080:8080 localai/localai:latest
docker run -ti --name local-ai -p 8080:8080 --gpus all localai/localai:latest-gpu-nvidia-cuda-13
From the README, exactly as the maintainers wrote it.
No reports for Linux yet.
GitManual AI Agent reads the 14 key files and writes a step-by-step guide for Linux. Once written, it's saved for everyone.