Is llm still maintained?

No, archived. The owners archived it: no more fixes or updates.

Widely used. 6.1k stars, 3 years old, by an organization. As with any download, get it from the official repo.

gitmanual

Reading the repo

Opening the box…

How to install on Windows

rustformers/llm

[Unmaintained, see README] An ecosystem of Rust libraries for working with large language models

Rust#ai#ggml#llm#ml

Difficulty: Easy
Time: about 5 min
Stars: ★ 6,145
Activity: Quiet for 2.4 years

Before you start

Is it free?: YesOpen source (Apache-2.0).
Still maintained?: No, archivedThe owners archived it: no more fixes or updates.
Can I trust it?: Widely used6.1k stars, 3 years old, by an organization. As with any download, get it from the official repo.

Saved setup from 2 h ago

Will it work on Windows?

Yes, it installs on your Windows

The repo is archived: it still works as-is, but nobody is fixing bugs anymore.
A ready-made Windows download is in the latest release.

Your system

macOS Windows Linux

Start here

Website ↗docs.rsThe project's own site.

Also: Docs ↗

Download for Windows

v0.1.1 · 5/8/2023 ↗

llm-cli-x86_64-pc-windows-msvc.zip

zip · x64 · 4.2 MB · 575 downloads · best match

Download

Add the extracted folder to your PATH if it's a CLI tool.

Invoke-WebRequest "https://github.com/rustformers/llm/releases/download/v0.1.1/llm-cli-x86_64-pc-windows-msvc.zip" -OutFile "llm-cli-x86_64-pc-windows-msvc.zip"
Expand-Archive "llm-cli-x86_64-pc-windows-msvc.zip" -DestinationPath .

Install with a package manager

Cargo

cargo install --git https://github.com/rustformers/llm llm-cli

Cargo

cargo install llm-cli

From the README, exactly as the maintainers wrote it.

Did you get it running?

No reports for Windows yet.

Still stuck? Ask an AI

Opens a chat with this manual already filled in, for Windows. It uses your own account; gitmanual sends nothing.

Ask Claude Ask ChatGPT

Parts list

1×Rust stableruntime

Share this manual

Is this your repo?

Add a badge to your README so newcomers find these steps.

[![Setup manual](https://gitmanual.com/rustformers/llm/badge.svg)](https://gitmanual.com/rustformers/llm)

Good to know

Cargo workspace — pick a crate with cargo run -p <name>.
The README mentions NVIDIA CUDA. Check its hardware section: some features (or all of them) may need an NVIDIA GPU.
Nested projects: binaries/generate-ggml-bindings/Cargo.toml, binaries/llm-cli/Cargo.toml, binaries/llm-test/Cargo.toml, binaries/precommit-check/Cargo.toml and 11 more

Details

License: Apache-2.0
Open issues: 81
Branch: main

Files we read (7)

.github/workflows/integration_tests.yml

.github/workflows/release.yml

.github/workflows/rust.yml

.gitmodules

Cargo.toml

README.md

doc/CONTRIBUTING.md

102 files in the repo