How to update my URL list?
FollowWebsite changes frequently so it is normal if the URLs in your crawler became outdated or you need to add more URLs. This article is about to show you how to update your original URLs.
1. Update single URL
If you need to update only one single URL, you could just update it in your task with the following steps.
- Click "Go To Web Page" in the workflow
- Paste your new URL into the "Page Url" bar
- Click "OK" to save
2. Update multiple URLs
In Octoparse, one crawler is created based on one website layout. Therefore, before you input a new list, please make sure they share the same website's layout. Or else, that links will not work with the crawler.
1) Select "Loop item" outside "Go To Web Page" and click the box or "Edit" next to "List of URLs"
2) Copy and paste the new URL list in the box and click "Save URL"
Then the URL list will be updated successfully.
If you are the Professional plan or Enterprise solution user, you will have the access to our advanced API which could help you update your URLs automatically. Check this link for more information: Advanced API - Update Task Parameter 
Artículo en español: ¿Cómo actualizar mi lista de URL?
También puede leer artículos de web scraping en el sitio web oficial
Author: Eric
Editor: Yanni
