Scrape product information from Shopee (V8.5)
FollowShopee is now a leading e-commerce online shopping platform in Southeast Asia and Taiwan, it now serves 16 countries/regions. It provides customers with easy, secure, and fast online shopping.
In this tutorial, we are going to show you how to scrape the product information from Shopee.
Octoparse has a pre-defined template to scrape Shopee and you can find it by searching on the home screen. You only need to input some parameters into the template to run it, the data will be scrapped.
If you prefer to build your own task, you can follow the steps below.
The URL below is the search results of the AirPods pro case in Shopee that we will be using as an example. We will show you the steps to extract the Product Name, Original Price, Sell Price and more for example.
Sample URL: https://shopee.sg/search?keyword=airpods%20pro%20case
Here are the steps in this tutorial:
- Create a Go to Web Page - to open the target website
- Auto-detect web page data - create a workflow
- Set up scroll - to load more products
- Run your task - get your target data
1. Create a Go to Web Page - to open the target website
- Create your task by inputting the URL in the search box on the homepage
- Click the "Start" button nearby to move on
2. Auto-detect web page data - create a workflow
- Click Auto-detect web page data and wait for it to complete
We need to check the data selected with the auto-detection.
- Go to Data preview to see if you're okay with the current data output
- Delete unnecessary data fields directly by clicking the delete icon
- Modify the data field names by double-clicking the headers
- Untick Add a page scroll, then click Create workflow
3. Set up scroll down - to load more products
The website requires us to scroll down the page to load more products.
- Click on the Go to web page
- Click Options
- Choose Scroll for one screen
- Set up the Repeat as 20
- Click Apply to save
- Click on Click to Paginate
- Set up the same scroll settings
4. Run your task - get your target data
- Save the task then Run from the upper right side
- Select Run on your device to run the task on your computer, or select Run in the Cloud to run the task in the Cloud (for premium users only)
Here is the sample data -
