Amazon Page Errors

Comments

3 comments

  • Kara

    Hi caitinc,

    Thank you for reaching out.

    Are you referring to the tasks you built by yourself? If so, it is very likely that the crawler was getting blocked by the website, because Amazon was very sensitive to web scraping, that's why all our built-in task templates for Amazon(https://helpcenter.octoparse.com/hc/en-us/articles/360028582331-Introducing-Easy-Template-A-Scraping-Solution-for-Muggles) are written with JavaScript. To use the regular task to scrape, you can try the methods introduced in these tutorials to avoid getting blocked:
    Set up wait time
    Octoparse Anti-Blocking Settings
    How to scrape websites without being blocked?

    Best regards,

    0
    Comment actions Permalink
  • caitinc

    Is there a way to build my tasks w/ Java?

    Unfortunately the template tasks do not have what I need. I am trying to pull data from the offers page to ID all offers on an ASIN. It looks like the templates only pull URL lists & detail page details.

    0
    Comment actions Permalink
  • Kara

    Hi caitinc,

    Thank you for your reply.

     For websites (Amazon, Twitter, Facebook, Instagram...) that only work with JavaScript crawlers, you'll need to customize a JavaScript template/crawler, the price would be started at $899. Let me know if you are interested in that.

    Best regards,

    0
    Comment actions Permalink

Please sign in to leave a comment.