Scrapivore
Docs menuErrors and limits
Reference

Errors and limits

What each status code means, the rate limits per token, and how to retry.

Status codes

Status
Meaning
200success: false
The API worked but no proxy got a good response. Read error and attempts. Not counted against your usage. Retry later or raise race_width.
400
Invalid input. The body names each field, for example:{"url": ["Enter a valid URL."]}
401
Missing or wrong token. The body is:{"detail": "Authentication credentials were not provided."}
402
Your Free plan has used its requests for this month. The body has used, limit and resets_at. Upgrade, or wait for the reset on the 1st.
404
Unknown preset or template.
429
Over your rate limit. Wait for the number of seconds in the Retry-After header.
503
The service is briefly at capacity. Retry after Retry-After seconds.

Rate limits

Endpoint
Limit
Scrape/api/scrape/
600/min per token
Batch scrape/api/scrape/batch/
30/min per token, up to 50 URLs each
Other endpoints/api/me/, /api/stats/, …
600/min per token
Register and login/api/auth/register/, /api/auth/login/
10/min per IP

Retrying well

  • Retry 429 and 503 after Retry-After. Don't retry 400 or 401 without changing the request.
  • For success: false, retry once or twice. The engine has already tried 3 × 2 proxies by then, and failed proxies are on cooldown, so the next try uses different ones.
  • Set your HTTP client's timeout above timeout × max_rounds plus a few seconds.