You are browsing a tutorial guide for the latest Octoparse version. If you are running an older version of Octoparse, we strongly recommend you upgrade because it is faster, easier, and more robust! Download and upgrade here if you haven't already done so!

Let's say you have created a magnificent crawler with branches and loops, and you realize you have to start scraping from multiple links instead of a single link. Now you look back at your workflow, which looks like this.

link0006.jpg

We understand how much you don't want to start over at the moment!

Here comes a simple solution with two steps to save you from work.

1. Add a Loop to open the list of links

  • Click Add Step to add a step at the top of the workflow

  • Choose Loop in the dropdown menu

link0004.jpg
  • Set the Loop Mode as List of URLs

  • Click Manual Input [0 URLs]

link0003.jpg
  • Copy and paste the URL list into the input box on the following page

link0002.jpg

A new Loop has now been set up.

link0001.jpg

2. Combine the new Loop with the rest of your workflow

  • Drag the rest of the workflow into the first Loop Item as shown in the picture below:

link0000.jpg
Did this answer your question?