You are browsing a tutorial guide for the latest Octoparse version. If you are running an older version of Octoparse, we strongly recommend you upgrade because it is faster, easier, and more robust! Download and upgrade here if you haven't already done so!
This tutorial will show you how to scrape product information, such as product title, price, seller, etc., from Etsy with the Octoparse.
To follow through, here is the example URL:
The main steps are shown in the menu on the right, and you can download the sample task file here.
1. Create a Go to Web Page - to open the target website
Enter the target URL on the Octoparse homepage and click Start
2. Auto-detect the webpage - to create a workflow
Click Auto-detect web page data and wait for it to complete
Create Workflow with Paginate to scrape more pages and Add a page scroll checked.
Go to Data Preview to see if you're okay with the current data output
Delete unnecessary data fields directly by clicking the three-dot icon next to the field name
Modify the data field names by double-clicking the headers
NOTE: For this specific task, please keep the Title_URL for the details page in the data preview section, as it will be used for the following steps.
3. Modify the XPath - to locate your desired data more accurately
Click on the More button next to the field name Title_URL
Select Customize XPath
Modify the XPath as: //a[contains(@class,'listing-link')]
Click Apply to save the settings
Repeat the same steps above to replace the XPath for the Title field to //h3
TIP: To learn more about XPath, please check out here: What is XPath and how to use it in Octoparse?
4. Select subpage URL - to extract data from the details page
Select subpage URL on the Tips panel
Choose Title_URL as the data field and click on Confirm
Once you enter the details page, click on your desired data field (e.g., Shop)
Choose Text on the Tips panel
Repeat the above steps to extract any other data on the details page
5. Run the task - to get your target data
Click Save and click Run on the upper right side
Select Run on your device to run the task on your computer.
Here's the sample data output for your reference.
