We have several tasks that are running and extracting data normally.

Comments

3 comments

  • Fergus

    There are some modifications you can try to make the task work:
    1. Uncheck the Block pop-up option and extend the timeout:


    2. Extend the AJAX Load time out for the click to paginate action:

    0
    Comment actions Permalink
  • Fergus

    we tried the adjustments you suggested and the task did run but the data/rows extracted is very low. In the image you sent you can see that it extracted only 27 rows. We expect to extract over 1600 rows.
    What else could we do?

    0
    Comment actions Permalink
  • Fergus

    We tried to split the task into two tasks: one to scrape the URLs of each detail page and the other task to go to the detail page URLs and scrape data.


    You can run the URL task first, and then input the URLs into the detail page. We have a feature to input URLs from another task directly so you don't need to export the URLs: Batch URL input

    0
    Comment actions Permalink

Please sign in to leave a comment.