Reading the repo
Reading the repo
How to install on Windows
A hierarchical inference engine for frontier MoE models: hot experts on the GPU (CUDA, Vulkan), warm ones in RAM, cold ones streamed from NVMe. Written in C, runs on the hardware you already own.
Saved setup from 3 h ago
The maintainers included START-HERE.bat. Run it from the cloned folder after reading it.
.\START-HERE.bat
Also: start-here.sh
Will it work on my device?
Invoke-WebRequest "https://github.com/JustVugg/colibri/releases/download/v2.1.0/colibri-v2.1.0-windows-x86_64.zip" -OutFile "colibri-v2.1.0-windows-x86_64.zip" Expand-Archive "colibri-v2.1.0-windows-x86_64.zip" -DestinationPath .
Invoke-WebRequest "https://github.com/JustVugg/colibri/releases/download/v2.1.0/colibri-v2.1.0-windows-x86_64-cuda.zip" -OutFile "colibri-v2.1.0-windows-x86_64-cuda.zip" Expand-Archive "colibri-v2.1.0-windows-x86_64-cuda.zip" -DestinationPath .
No reports for Windows yet.
Opens a chat with this manual already filled in, for Windows. It uses your own account; gitmanual sends nothing.