Infinite Scroll has setup but no new elements added to the list?
FollowWhen you're scraping a website that applies scroll-down/show more buttons to load more content, you may encounter such a scenario:
Even if you've set up a scroll-way with Octoparse or set up to click on show more buttons, you may still find no new items added to the loop item list or when the task runs, it still collects only a limited number of data rows.
This is because Octopasre generates the loop item in Fixed List. You may follow this tutorial to check and solve the problem. Take the picture below as an example:
You may notice that the current Loop mode is under the Fixed List mode.
Unlike the Variable List, Fixed List will only include items according to the fixed list of XPath you enter into the text box. Therefore, when dealing with dynamic items, or when the number of items would vary in different pages, you need to switch the loop mode to the Variable list because it can automatically detect and match all the items corresponding to a certain XPath.
To solve this problem, you also need to modify the XPath. Check out this tutorial Customize element Xpath to know more about XPath.
After changing the Loop Mode to variable list, we can then input the correct Xapth into the Matching Xpath box to locate all the target items on the page. Remember to click apply to save the settings.
Contact us if you have any questions.
Happy data hunting!
Artículo en español: ¿Se ha configurado Infinite Scroll pero no se agregaron elementos nuevos a la lista?
También puede leer artículos de web scraping en el sitio web oficial
Author: Vanny
