Why "AJAX Load" slows down the process
Before Octoparse goes on to execute actions such as "Click item" and "Click to paginate", it needs to confirm that the page's fully loaded. And to do this, Octoparse takes page-reloading as the signal for when the web page is ready for the next action in the workflow. For web page that loads with AJAX though, the new content is usually updateded without reloading, in this case, Octoparse would not get the signal to proceed. As a result, you may get zero, or much less data extracted than expected.
To work around this issue, we can set up an "AJAX Load" timeout for the "Click Item" action. When the timeout is reached, Octopares will proceed to the next action regardless of whether page-reloading is detected.
Where to set up the "AJAX Load"
- Go to the settings of the "Click Item" or "Click to Paginate" action
- Tick "Load with AJAX"
- Select an AJAX timeout according to how fast your page loads