Set up a waiting time is to slow down the execution of the current step. Its ultimate purpose is to make sure the steps of the scraper process properly.
Why does it need to "wait before execution"?
In some cases, the previous step may require certain time to complete, like manual input, or the current page requires a longer time to load. So you would need to set up "Wait before execution" for steps like those. Otherwise, it may lead to some error like missing data.
How to set up "Wait before execution"
- All steps created in the workflow are able to set up a waiting time, except "Go To Web Page". It’s easily found "Wait before execution" in the "Advanced Options".
- Wait time options in Octoparse. So far, it’s not available to customize the waiting time.
|
Tips! 1. Set up a waiting time will prolong the execution of the task. Please make sure that the step needs to "wait before execution", or it will impact the effectiveness of the crawler. 2. Please remember to click "Save" after changing any settings. |
Related articles:
Extract data from a list of URLs 