Pagination with "Load more" button

Comments

3 comments

  • Brian

    Hi keldonbrand,

    Thank you for reaching out.

    When we check the webpage we can see, after clicking on that load more button, we'll need to scroll down the page several times to get to see the next load more button, so we can try to set up scroll down for the Go to Web Page action:

     

    And for the pagination button:

    You can modify the way of scrolling down and repeating times, test different settings to see which is the proper one for this site.

    Best regards,

    0
    Comment actions Permalink
  • keldonbrand

    Hello,

     

    Thank you for your help, it sort of worked. However, my probem now is that the amount of looping is too much. From what I've seen, it first goes through the 60 products, then presses the Load More button, then goes through the first 60 and the newly loaded 60 products, creating 60 duplications already. When the product numbers are around 1000, the amount of duplications becomes way too much and so does the extraction time. Is it possible to make the process like this?

    Extract the 60 products, then click on the "Load more" button, then extract the next 60 products, the click on "Load more" button, etc.?

    0
    Comment actions Permalink
  • Brian

    Hi keldonbrand,

    Please submit a request with your task attached, so we can help debug and revise it. Please check:

    https://helpcenter.octoparse.com/hc/en-us/requests/new

    https://helpcenter.octoparse.com/hc/en-us/articles/360020888352-How-to-export-a-task-

    Best regards,

    0
    Comment actions Permalink

Please sign in to leave a comment.