Skip to content

Reading the repo

Opening the box…

How to install llama.cpp on Windows (ggml-org/llama.cpp) · gitmanual

How to install on Windows

ggml-org/llama.cpp

LLM inference in C/C++

PythonC/C++ (CMake)#ggml

Difficulty: Moderate
Time: about 15 min
Stars: ★ 133,555
Activity: Updated this month
License: MIT
Open issues: 2,589
Got it running: Be the first
Looked up: 6 h ago

Saved setup from 6 h ago

Start here

Website ↗llama.appThe project's own site.

Setup script in the repo

The maintainers included scripts/install-oneapi.bat. Run it from the cloned folder after reading it.

.\scripts\install-oneapi.bat

Will it work on my device?

Yes, it installs on your Windows

A ready-made Windows download is in the latest release.

Checking for

macOS Windows Linux

Download for Windows

b12173 (pre-release) · 11/6/2026 ↗

cudart-llama-bin-win-cuda-12.4-x64.zip

zip · x64 · 391.4 MB · best match

Add the extracted folder to your PATH if it's a CLI tool.

Invoke-WebRequest "https://github.com/ggml-org/llama.cpp/releases/download/b12173/cudart-llama-bin-win-cuda-12.4-x64.zip" -OutFile "cudart-llama-bin-win-cuda-12.4-x64.zip"
Expand-Archive "cudart-llama-bin-win-cuda-12.4-x64.zip" -DestinationPath .

Other Windows downloads (10)

cudart-llama-bin-win-cuda-13.5-x64.zip

zip · x64 · 426.3 MB

Add the extracted folder to your PATH if it's a CLI tool.

Invoke-WebRequest "https://github.com/ggml-org/llama.cpp/releases/download/b12173/cudart-llama-bin-win-cuda-13.5-x64.zip" -OutFile "cudart-llama-bin-win-cuda-13.5-x64.zip"
Expand-Archive "cudart-llama-bin-win-cuda-13.5-x64.zip" -DestinationPath .

llama-b12173-bin-win-cpu-x64.zip

zip · x64 · 24.7 MB

Add the extracted folder to your PATH if it's a CLI tool.

Invoke-WebRequest "https://github.com/ggml-org/llama.cpp/releases/download/b12173/llama-b12173-bin-win-cpu-x64.zip" -OutFile "llama-b12173-bin-win-cpu-x64.zip"
Expand-Archive "llama-b12173-bin-win-cpu-x64.zip" -DestinationPath .

llama-b12173-bin-win-cuda-12.4-x64.zip

zip · x64 · 288.7 MB

Add the extracted folder to your PATH if it's a CLI tool.

Invoke-WebRequest "https://github.com/ggml-org/llama.cpp/releases/download/b12173/llama-b12173-bin-win-cuda-12.4-x64.zip" -OutFile "llama-b12173-bin-win-cuda-12.4-x64.zip"
Expand-Archive "llama-b12173-bin-win-cuda-12.4-x64.zip" -DestinationPath .

llama-b12173-bin-win-cuda-13.5-x64.zip

zip · x64 · 170.8 MB

Add the extracted folder to your PATH if it's a CLI tool.

Invoke-WebRequest "https://github.com/ggml-org/llama.cpp/releases/download/b12173/llama-b12173-bin-win-cuda-13.5-x64.zip" -OutFile "llama-b12173-bin-win-cuda-13.5-x64.zip"
Expand-Archive "llama-b12173-bin-win-cuda-13.5-x64.zip" -DestinationPath .

llama-b12173-bin-win-openvino-2026.4.1-x64.zip

zip · x64 · 104.7 MB

Add the extracted folder to your PATH if it's a CLI tool.

Invoke-WebRequest "https://github.com/ggml-org/llama.cpp/releases/download/b12173/llama-b12173-bin-win-openvino-2026.4.1-x64.zip" -OutFile "llama-b12173-bin-win-openvino-2026.4.1-x64.zip"
Expand-Archive "llama-b12173-bin-win-openvino-2026.4.1-x64.zip" -DestinationPath .

llama-b12173-bin-win-rocm-10.0-x64.zip

zip · x64 · 267.3 MB

Add the extracted folder to your PATH if it's a CLI tool.

Invoke-WebRequest "https://github.com/ggml-org/llama.cpp/releases/download/b12173/llama-b12173-bin-win-rocm-10.0-x64.zip" -OutFile "llama-b12173-bin-win-rocm-10.0-x64.zip"
Expand-Archive "llama-b12173-bin-win-rocm-10.0-x64.zip" -DestinationPath .

cudart-llama-bin-win-cuda-13.5-arm64.zip

zip · ARM64 · 278.8 MB

Add the extracted folder to your PATH if it's a CLI tool.

Invoke-WebRequest "https://github.com/ggml-org/llama.cpp/releases/download/b12173/cudart-llama-bin-win-cuda-13.5-arm64.zip" -OutFile "cudart-llama-bin-win-cuda-13.5-arm64.zip"
Expand-Archive "cudart-llama-bin-win-cuda-13.5-arm64.zip" -DestinationPath .

llama-b12173-bin-win-cpu-arm64.zip

zip · ARM64 · 13.2 MB

Add the extracted folder to your PATH if it's a CLI tool.

Invoke-WebRequest "https://github.com/ggml-org/llama.cpp/releases/download/b12173/llama-b12173-bin-win-cpu-arm64.zip" -OutFile "llama-b12173-bin-win-cpu-arm64.zip"
Expand-Archive "llama-b12173-bin-win-cpu-arm64.zip" -DestinationPath .

llama-b12173-bin-win-cuda-13.5-arm64.zip

zip · ARM64 · 158.4 MB

Add the extracted folder to your PATH if it's a CLI tool.

Invoke-WebRequest "https://github.com/ggml-org/llama.cpp/releases/download/b12173/llama-b12173-bin-win-cuda-13.5-arm64.zip" -OutFile "llama-b12173-bin-win-cuda-13.5-arm64.zip"
Expand-Archive "llama-b12173-bin-win-cuda-13.5-arm64.zip" -DestinationPath .

llama-b12173-bin-win-opencl-adreno-arm64.zip

zip · ARM64 · 14.2 MB

Add the extracted folder to your PATH if it's a CLI tool.

Invoke-WebRequest "https://github.com/ggml-org/llama.cpp/releases/download/b12173/llama-b12173-bin-win-opencl-adreno-arm64.zip" -OutFile "llama-b12173-bin-win-opencl-adreno-arm64.zip"
Expand-Archive "llama-b12173-bin-win-opencl-adreno-arm64.zip" -DestinationPath .

Did you get it running?

No reports for Windows yet.

Still stuck? Ask an AI

Opens a chat with this manual already filled in, for Windows. It uses your own account; gitmanual sends nothing.

Ask Claude Ask ChatGPT

Parts list

1×Python >=3.10,<3.15runtime
1×C/C++ compiler runtime
1×CMake 3.14...3.28runtime
1×poetry package manager

3× settings in .env

VITE_PUBLIC_APP_NAME
VITE_DEBUG
VITE_PUBLIC_SERVER_ORIGIN

Share this manual

Is this your repo?

Add a badge to your README so newcomers find these steps.

[![Setup manual](https://gitmanual.com/ggml-org/llama.cpp/badge.svg)](https://gitmanual.com/ggml-org/llama.cpp)

Good to know

Native projects often need extra system libraries. If the build stops with a missing package, check the maintainers' build guide (see Start here).
The README mentions NVIDIA CUDA. Check its hardware section: some features (or all of them) may need an NVIDIA GPU.
Has AGENTS.md — instructions for coding agents. You can open Claude Code (or another agent) in the cloned folder and ask it to do the setup for you.
Nested projects: app/CMakeLists.txt, common/CMakeLists.txt, examples/CMakeLists.txt, examples/batched/CMakeLists.txt and 11 more

Files we read (13)

.github/workflows/behavior-check.yml

.github/workflows/build-3rd-party.yml

.github/workflows/build-and-test-snapdragon.yml

.github/workflows/build-android.yml

.github/workflows/build-apple-daily.yml

.github/workflows/build-apple.yml

CMakeLists.txt

Makefile

README.md

docs/install.md

pyproject.toml

requirements.txt

tools/ui/.env.example

Branch master · 4,074 files in the repo