Scraping Data from Multiple URLs



  • Emma

    Hi paforson,

    Thank you for reaching out.

    If your target data can be located with the same XPath from all the URLs, then yes, you can build just one task to scrape this data field. 

    You can now import URLs from any of the file formats below,

    - CSV

    - TXT

    - Excel (.xlsx & .xls)

    To learn how, please check out this tutorial:

    Best regards,

    Comment actions Permalink
  • Emma

    And if you know how to code, you can use the advanced API to manage the list of target URLs to be submitted to Octoparse, read the target URL list from a database or XML file. Here's the doc for your reference:

    Comment actions Permalink

Please sign in to leave a comment.