I am trying to extract the listing information from Gumtree.co.za and all the data is extracted fine, except for the image URLs. You can look at https://www.gumtree.co.za/s-automotive-vehicles/free-state/v1c5l3100236p1?q=hilux to see how the site works
What I can tell is that they use lazyloading for the images, so you first have to scroll down over the image before it is loaded.
I have setup the page load to scroll down a few screens (scroll down = 30, interval = 0.5, scroll way = scroll down for one screen) before the scraping starts. This then at least loads the images into the browser, but the data is still not correct. Only the first image is found and then the same image path is "scraped" for the records after that first listing.
Is there a better way to achieve the image path extraction or do I need to configure something else also to make this work?
Please sign in to leave a comment.