Does your product support 2 levels deep crawling?

Follow

Scarlett

• August 27, 2020 11:45

Hi there,

Does your product support 2 levels deep crawling? For example - I run a search for "restaurants in San Francisco" on google. Now it shows me a list of restaurants. But to get all the information about each restaurant I need to click on each restaurant link to get their address and website info. Then come back to the list page and click on the next restaurant and repeat this on every page.

Can your crawler do that? If so, is there a tutorial for it?

0

• 

  Scarlett

  • August 27, 2020 11:45

  Yes, Octoparse can do it as you require. You can follow these tutorials to build a custom crawler.
  
  How to scrape from the list page and detail page at the same time？
  Scrape data in Google Maps

  0

  Comment actions Permalink
• 

  fatscatmat

  • August 05, 2021 13:33

  Here is a configuration I discovered that works for deeper levels:

  https://helpcenter.octoparse.com/hc/en-us/community/posts/4404623880473-Deep-dives-into-websites

  0

  Comment actions Permalink

Please sign in to leave a comment.