I need help with a crawler for Amazon that I am building. I can't seem to figure out how to just tell it "Alright, get me whatever product information you can find. Click every link and find every product" kinda task.
I need help with a crawler for Amazon that I am building. I can't seem to figure out how to just tell it "Alright, get me whatever product information you can find. Click every link and find every product" kinda task.
-
I'm afraid Octoparse can't work that way based on your scenario. Most of our clients will scrape information from the listing page or detail page based on keywords or ASINs. Some of them will scrape data from the top seller section or department section.
You can follow our tutorials to see if they can help you solve your problems.
Scrape reviews from Amazon
Scrape product information from Amazon
Scrape product images from Amazon
Video-Scrape product information from Amazon
Scrape Amazon product information with ASIN/UPC
Please sign in to leave a comment.
Comments
1 comment