Reading the repo

Opening the box…

Assembly instructions

D4Vinci/Scrapling

🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev

Python#ai#ai-scraping#automation#crawler

Difficulty: Moderate
Time: about 15 min
Stars: ★ 97,746
Activity: Updated this month
License: BSD-3-Clause
Open issues: 13
Got it running: Be the first
Looked up: 3 h ago

Saved setup from 3 h ago

Start here

Website ↗scrapling.readthedocs.ioThe project's own site.Docs ↗scrapling.readthedocs.ioLinked from the README.

Will it work on my device?

Yes, it installs on your macOS

The README gives a pip install for macOS.

Checking for

Install with a package manager

pip

pip install "scrapling[shell]"

pip

pip install scrapling

pip

pip install "scrapling[fetchers]"

pip

pip install "scrapling[ai]"

pip

pip install "scrapling[rag]"

pip

pip install "scrapling[all]"

From the README, exactly as the maintainers wrote it.

Run it with Docker

A self-hosted app: Docker runs it on your computer and you open it in the browser. Needs Docker Desktop (or Docker Engine on Linux). Run docker compose commands inside the cloned repo folder.

Docker

docker pull pyd4vinci/scrapling

Docker

docker pull ghcr.io/d4vinci/scrapling:latest

From the README, exactly as the maintainers wrote it.

Did you get it running?

No reports for macOS yet.

Still stuck? Get a written guide

Claude reads the 8 key files and writes a step-by-step guide for macOS. Once written, it's saved for everyone.