As i am trying this out with no data scraping background, it takes quite a while to read through and try the tutorials.

Comments

1 comment

  • Fergus

    To scrape Shopee, we will need to configure two tasks, one to collect data information(especially the product URL) from the listing page, the other task to go to the product URLs to get data.

    You can check this tutorial for more info: https://helpcenter.octoparse.com/hc/en-us/articles/360018327751-Video-Extract-data-using-a-list-of-URLs- 


    And please note that you need to set up scroll down for the Go to web page action and click to paginate actions. The website requires scrolling down to load the page completely.
    Dealing with Infinitive Scrolling/Load More

    As for scraping the images, Shopee does not use IMG tag to include the image URL. We need to scrape the HTML code of the element first, then match out the URL from the code:


    Use Match with Regular Expression: Re-format data extracted


    The regular expression can be generated with our RegEx tool:


    0
    Comment actions Permalink

Please sign in to leave a comment.