How to update my URL list?(Version 8)
FollowAfter a task finishes scraping, you may want to use the same task to get data from another similar URL. This article describes how to update the URL list in a task.
1. Update single URL
If there is only one starting URL in the task(no "Loop URLs"), you can follow the steps below to update it.
- Click "Go To Web Page" in the workflow
- Paste your new URL into the "URL" box
- Click "OK" to save
2. Update multiple URLs
Octoparse allows users to loop their a list of URLs based on the same webpage layout by creating a loop item. It is quite essential to make sure all the URLs are from the same domain, which is the precondition of successful Loop URLs action. Otherwise, Octoparse will not be able to recognize the URLs and perform further extraction steps.
- Select "Loop URLs" outside "Go To Web Page" and click
- Click the edit button
- Copy and paste the new URL list into the box and click "Save"
Then the URL list will be updated successfully. You can also select the other 3 ways to input new URLs: Batch URL input
3. Update URLs with API
If you are a Professional plan or an Enterprise solution user, you will have the access to our advanced API which could help you update your URLs automatically without opening Octoparse software. Check this link for more information: Advanced API - Update Task Parameter
Is this article helpful? Contact us at any time if you need our help!
Author: Lesley
Editor: Yina
