What is the Scrape Page Limit?

The Scrape Page Limit is the number of web pages the Web Scraper can scrape before your page limit is reset on the reset date. Every time the Web Scraper traverses a web page during your scrape one page in the Scraper Page Limit is used. Even if information is not extracted from the web page. The Scrape Page Limit is not affected by taking captures. You can find your current Scrape Page Limit on your account page.

What happens if I go over my limit?

If you go over your limit you cannot do anymore scrapes until your package resets, or you buy the same or another package. The account owner will be warned by email when your allowance hits 20%.

It's a good idea when creating your scrape to use the Scrape Limit option on the Scrape Options tab. This will limit your scrape to set number of pages, allowing you to see if it works before doing a full scrape.

You can programmatically check you allowance by using the User Details REST API method.