Comments

3 comments

  • Brian

    Hi nzundel,

    Thank you for reaching out.

    Please try modify the XPath of the pagination loop into //button[text()='Next']

    And it looks like this website applies AJAX(Deal with AJAX) to load new content, so after we click on the detail page to scrape data, the system fails to go back to the list page automatically. As a result, we need to split the task into two, extract the detail page URLs with Octoparse firstly, and then scrape data you want with the URL list. If you are new to URLs list extraction, please check out this video tutorial: [Click here]

    Best regards,

    1
    Comment actions Permalink
  • nzundel

    Hi Kara, 

    Thank you. Unfortunately I'm unable to even extract the URL list. I follow the steps but am only finding options to extract the inner/outer HTML, never able to extract the URL. Any insight/advice is greatly appreciated. 

    Thanks,

     

    0
    Comment actions Permalink
  • Brian

    Hi nzundel,

    Thank you for your reply.

    When you select an item with a URL, the selected tag on the bottom of "Tips" should be "A", which stands for an anchor that usually links one page to another. Please make sure you select the right area.

    If it's still not working, please submit a ticket with your task attached for our further checking, here' the tutorial:

    https://helpcenter.octoparse.com/hc/en-us/requests/new

    https://helpcenter.octoparse.com/hc/en-us/articles/360020888352-How-to-export-a-task-

    Best regards,

    0
    Comment actions Permalink

Please sign in to leave a comment.