Does your product support 2 levels deep crawling? For example - I run a search for "restaurants in San Francisco" on google. Now it shows me a list of restaurants. But to get all the information about each restaurant I need to click on each restaurant link to get their address and website info. Then come back to the list page and click on the next restaurant and repeat this on every page.
Can your crawler do that? If so, is there a tutorial for it?
Please sign in to leave a comment.