Scrapivore
Docs menuBatch scrape
Scraping

Batch scrape

POST/api/scrape/batch/

Scrapes up to 50 URLs in one call. Each URL runs the same race as /api/scrape/. Results come back in the same order as urls.

Body parameters

Parameter
Description
urls required
List of up to 50 URLs.
concurrency int · default 20
URLs processed at the same time, 1–50.
dedupe_cidr bool · default false
Use at most one proxy per /24 network across the batch. Recommended: it lowers the chance that one blocked network fails many URLs.

All the scrape options (source, headers, timeout, race_width and the rest) apply to every URL.

Only the successful results count toward your usage.