I have a crawler task I'm trying to set up and I have a mistake somewhere so that it's not working the way it should.

Comments

1 comment

  • Kara

    Hi there,

    There are several "Clicking Items" in the workflow, for some of these clicking actions, the webpage loads now content with AJAX loading(Deal with AJAX), which means for these steps, the system will not be able to go back to the former page to click on the next items in the loop. For situations like this, we'll need to split the task into two or more, here we need to split it into three, the first two to extract detail page URLs with Octoparse firstly, and then scrape the data we want with the URL list. 

    If you are new to URLs list extraction, please follow this video tutorial to build the next tasks. [Click here]

    Best regards,

    0
    Comment actions Permalink

Please sign in to leave a comment.