Does your product support 2 levels deep crawling?
Hi there,
Does your product support 2 levels deep crawling? For example - I run a search for "restaurants in San Francisco" on google. Now it shows me a list of restaurants. But to get all the information about each restaurant I need to click on each restaurant link to get their address and website info. Then come back to the list page and click on the next restaurant and repeat this on every page.
Can your crawler do that? If so, is there a tutorial for it?
-
Yes, Octoparse can do it as you require. You can follow these tutorials to build a custom crawler.
How to scrape from the list page and detail page at the same time?
Scrape data in Google Maps -
Here is a configuration I discovered that works for deeper levels:
https://helpcenter.octoparse.com/hc/en-us/community/posts/4404623880473-Deep-dives-into-websites
Please sign in to leave a comment.
Comments
2 comments