Scrape product information from Shopee(V8.5)

Shopee is now a leading e-commerce online shopping platform in Southeast Asia and Taiwan, it now serves 16 countries/regions. It provides customers with easy, secure, and fast online shopping. 

In this tutorial, we are going to show you how to scrape the product information from Shopee.

Octoparse has a pre-defined template to scrape Shopee and you can find it by searching on the home screen. You only need to input some parameters into the template to run it, the data will be scraped. 

If you prefer to build your own task, you can follow the steps below.

The URL below is the search results of AirPods pro case in Shopee that we will be using as an example. We will show you the steps to extract the Product Name, Original Price, Sell Price and more for example.

Sample URL: https://shopee.sg/search?keyword=airpods%20pro%20case

Here are the steps in this tutorial:

1. Create a Go to Web Page - to open the target website
2. Auto-detect web page data - create a workflow
3. Set up scroll - to load more products
4. Run your task - get the data you want

1. Create a Go to Web Page - to open the target website

• Create your task by inputting the URL in the search box on the homepage
• Click the "Start" button nearby to move on

2. Auto-detect web page data - create a workflow

• Click Auto-detect web page data and wait for it to complete

We need to check the data selected with the auto-detection.

• Go to Data preview to see if you're okay with the current data output
  • Delete unnecessary data fields directly by clicking the delete icon
  • Modify the data field names by double-clicking the headers

• Untick Add a page scroll, then click Create workflow

3. Set up scroll down - to load more products

The website requires us to scroll down the page to load more products. 

• Click on the Go to web page
• Click Options
• Choose Scroll for one screen
• Set up the Repeat as 20
• Click Apply to save

• Click on Click to Paginate
• Set up the same scroll settings

4. Run your task - get data you want

• Click"Save", and click "Run" on the upper right side
• Select "Run on your device" to run the task on your computer, or select "Run in the Cloud" to run the task in the Cloud (for premium users only)

Here is the sample data.

If you have further issues with the task or have a suggestion that would make this a better resource for you, we’d love to hear about it. Submit a request here.

Author: Kisad

Editor: Yina