Does leanctx use paid AI services?

Can use Anthropic, OpenAI or OpenRouter. Its settings have keys for these paid APIs. Its README says whether one is required.

Is leanctx still maintained?

Yes, active. Last change 3 months ago. Latest release v0.3.1, 7 months ago.

Some track record. 321 stars, 7 months old. Get it from the official repo and read what it installs.

gitmanual

Reading the repo

Opening the box…

How to set up leanctx (jia-gao/leanctx) · gitmanual

Assembly instructions

jia-gao/leanctx

Drop-in prompt compression for production LLM apps. Cut your token bill 40-60% without changing your code. Python SDK, LLMLingua-2, MIT.

Python#anthropic#cost-optimization#gemini#langchain

Before you start

Is it free?: YesOpen source (MIT).
Paid AI services?: Can use Anthropic, OpenAI or OpenRouterIts settings have keys for these paid APIs. Its README says whether one is required.
Still maintained?: Yes, activeLast change 3 months ago. Latest release v0.3.1, 7 months ago.
Can I trust it?: Some track record321 stars, 7 months old. Get it from the official repo and read what it installs.

Difficulty: Easy
Time: about 5 min
Stars: ★ 321
Activity: Updated 3 months ago

Saved setup from 9 h ago

Will it work on macOS?

Yes, it installs on your macOS

The README gives a pip install for macOS.

Your system

macOS Windows Linux

Start here

Heads-upBuilding it yourself? It also needs 10 settings in .env (3 secret).

Install with a package manager

pip

pip install 'leanctx[openai,lingua]'    # or [anthropic], [gemini]

pip

pip install leanctx                              # core (passthrough only — useful for testing the wrapper)

pip

pip install 'leanctx[anthropic,openai,gemini]'   # provider SDKs

pip

pip install 'leanctx[lingua]'                    # + LLMLingua-2 local compression (~1.2 GB on first call)

pip

pip install 'leanctx[otel]'                      # + OpenTelemetry API/SDK

pip

pip install 'leanctx[bench]'                     # + respx for offline scenarios

pip

pip install 'leanctx[longbench]'                 # + HuggingFace datasets for LongBench v2

pip

pip install 'leanctx[server]'                    # + FastAPI/uvicorn HTTP compression sidecar

pip

pip install 'leanctx[all]'                       # everything

pip

pip install 'leanctx[server,lingua]'

pip

pip install 'leanctx[lingua]'

From the README, exactly as the maintainers wrote it.

Did you get it running?

No reports for macOS yet.

Still stuck? Get a written guide

GitManual AI Agent reads the 8 key files and writes a step-by-step guide for macOS. Once written, it's saved for everyone.

Parts list

1×Python 3.12runtime
1×pip package manager

10× settings in .env

ANTHROPIC_API_KEYsecret
OPENAI_API_KEYsecret
BENCHMARK_EVAL_PROVIDER
BENCHMARK_EVAL_MODEL
OPENROUTER_API_KEYsecret
LEANCTX_SERVER_MODE
LEANCTX_SERVER_THRESHOLD
LEANCTX_SERVER_LINGUA_RATIO
LEANCTX_SERVER_LINGUA_DEVICE
LEANCTX_SERVER_DEDUP

Share this manual

Is this your repo?

Add a badge to your README so newcomers find these steps.

[![Setup manual](https://gitmanual.com/jia-gao/leanctx/badge.svg)](https://gitmanual.com/jia-gao/leanctx)

Good to know

Dockerfile available (base image: python:3.11-slim).
Nested projects: integrations/clawrouter/connector/package.json, integrations/insforge/connector/package.json, ts/package.json

Details

License: MIT
Open issues: 1
Branch: main

Files we read (8)

.env.example

.github/workflows/ci.yml

.python-version

Dockerfile

README.md

integrations/clawrouter/.env.example

integrations/insforge/.env.example

pyproject.toml

180 files in the repo

Yes, it installs on your macOS

Start here

Install with a package manager

Did you get it running?

Still stuck? Get a written guide

More like leanctx that run on macOS