Tools to Capture and Convert the Web
GrabzIt's Online Community

capturing multiple levels of website

Ask questions relating to GrabzIt's Web Scraper Tool. Such as how to use the web scraper and API to extract data from web pages, images or PDF documents.

I am trying to capture the entire contents of a website with multiple levels. I have tried using online tool, but it only captures the first page, which is links to chapters. If I click on those links, I then get links to subchapters, and then ultimately to sections. I could capture each section indivudally, but there are hundreds of those and I'm trying to avoid all that work. 

Asked by anonymous on the 8th of October 2022

It sounds like this is a web scraping question so I have moved it here. Presumably you have used one of these templates: https://grabz.it/scraper/templates/

If you have and it doesn't work there must be something special about the links. This will require you to write your own scrape. We don't help with writing scrapes as it is a self service tool.

 

Answered by GrabzIt Support on the 9th of October 2022

None of the multi-level web scrapes templates work. You will always need to write your own. I have now tried on multiple sites with the same issue.

Answered by Andre Barnett on the 6th of August 2024