I have an example:
Lets say I want to crawl all of the product pages details for all products that end up on the search result of "ABC toys" on walmart.ca.
Lets say the search results end up showing 8 products.
Would the above task count as 9 crawler tasks? So the first crawler task is crawling the search results for "ABC toys" on walmart.ca, and then the remaining 8 tasks are to extract each product page one by one?
Please sign in to leave a comment.