Articles in this section

See more

Scrape product data from Canadian Tire

  • Updated
Follow

In this tutorial, we will show you how to collect product information on canadiantire.com with Octoparse.

For Canadian Tire, you could visit our easy-to-use "Task Template" on the main screen of the Octoparse scraping tool. All you need is to type in several parameters and the task is ready to go. For further details, you may check it out here: Task Templatesexternal-link-symbol-1.png

We will scrape title, price and stock from this website. To follow through, you may want to use this URL in the tutorial:

https://www.canadiantire.ca/en/search-results.html?q=bulb

This tutorial will also cover:

  • Deal with AJAX for pagination

Here are the main steps in this tutorial [Download demo task from here ]:

  1. "Go To Web Page" - open the targeted web page
  2. Create a pagination loop -  scrape all the results from multiple pages
  3. Create a "Loop Item" -  loop click into each item on each list
  4. Extract data -  select the data for extraction
  5. Start extraction - run the task and get data
1."Go To Web Page" - open the targeted web page 
  • Click "+ Task" to start a new task with Advanced Mode
  • Paste the URL into the "Extraction URL" box
  • Click "Save URL" to move on

1.gif

2. Create a pagination loop - scrape search results from all pages
  • Scroll down to the bottom of the page, click the "LOAD MORE RESULTS" button
  • Click "Loop click next page" on "Action Tips" panel
  • Uncheck "Retry when pages remains unchanged"
  • Set up an AJAX loading for 5s (optional according to your local network condition)
  • Click "Pagination" and then click "End loop when"
  • Check "Execution times each" and set 5 times
  • Click "OK" to save

2.gif

Tips!

AJAX timeout can often be used as webpage timeout for Click Action. For example, when you have a page that takes forever to finish loading, long after the data you need gets loaded, you can conveniently use AJAX timeout to tell Octoparse to move on to the next action when the set time is reached. If you want to learn more about AJAX, here are the related links.
 
3. Create a "Loop Item" - scrape all the items on each page
  • Click on the first three product on the page
  • Click "Loop click each element" on the "Action Tips" panel
  • Uncheck "Uncheck the box for "Retry when page remains unchanged (use discreetly for AJAX loading)"
  • Set up an AJAX loading for 5s (optional)
  • Click "Save"

3.gif

4. Extract data - select the data for extraction
  • Click on the data you need on the page
  • Select "Extract text of the selected element" from the "Action Tips"

4.gif

  • Rename the fields by selecting from the pre-defined list or inputting on your own

sample_field.png

 
5. Save and start extraction - run the task and get data
  • Click"Save"
  • Click "Start Extraction" on the upper left side
  • Select "Local Extraction" to run the task on your computer, or select "Cloud Extraction" to run the task in the Cloud (for premium users only)

5.gif

Here's the data we extracted.

sample_output.png

Happy data hunting!