Reading the repo
Reading the repo
How to install on Windows
DeepInfer: High-performance, large-scale inference framework for DeepSeek models
Saved setup from 4 h ago
Will it work on my device?
winget install Git.Git) or WSL2 (wsl --install).Then run powershell -ExecutionPolicy Bypass -File .\setup.ps1. It stops at the first error and is safe to run again. Servers and tests aren't started; it lists them at the end. Read it first.
Needs Git: winget install Git.Git. The repo uses git submodules, so the clone fetches them too.
git clone --recurse-submodules https://github.com/deepseek-ai/DeepInfer.git cd DeepInfer
Python >=3.12
winget install Python.Python.3.12
python -m venv .venv .venv\Scripts\Activate.ps1 pip install -r requirements.txt pip install -r requirements-dev.txt
pytest
The steps run shell scripts (.sh). Use Git Bash (winget install Git.Git) or WSL2 (wsl --install).
Before building DeepInfer, please create and activate an empty Python 3.12 environment.
# Use `ascend` instead for the Ascend platform
# Keep it exported in the environment where you run DeepInfer
export DEEPINFER_ACCELERATOR=nvidia
./build.sh
The default checkpoint, deepseek-ai/DeepSeek-V4.1-Flash-1017, is
downloaded into the Hugging Face cache on the first run; set DEEPINFER_HF_MODEL_DIR=/path/to/DeepSeek-V4.1-Flash-1017 to
run from a local copy instead.
python examples/offline_inference.py
See examples for details.
No reports for Windows yet.
Opens a chat with this manual already filled in, for Windows. It uses your own account; gitmanual sends nothing.