How can I make sure to scrape only new listings and not all listings on the site?
I am scraping https://www.carsales.com.au/cars/?q=Service.Carsales, and I need to scrape it once a day for new listings, how can I make sure to scrape only new listings and not all 120K plus listings on the site?
-
Hi there,
You can enable the incremental extraction feature to only extract the new listings. You can follow this tutorial to set it up.
Incremental Extraction- Get updated data easily
Please sign in to leave a comment.
Comments
1 comment