How can I make sure to scrape only new listings and not all listings on the site?

Follow

Kiki

• September 29, 2020 02:15

I am scraping https://www.carsales.com.au/cars/?q=Service.Carsales, and I need to scrape it once a day for new listings, how can I make sure to scrape only new listings and not all 120K plus listings on the site?

0

• 

  Kiki

  • September 29, 2020 02:15

  Hi there,

  You can enable the incremental extraction feature to only extract the new listings. You can follow this tutorial to set it up.
  Incremental Extraction- Get updated data easily

  0

  Comment actions Permalink

Please sign in to leave a comment.