The extraction speed of a crawler is affected by the speed of page loading. If many unexpected ads appear on the web page, such as banners and pop-ups, the page will load slowly and waste your time. Ad blocking can reduce your page requests and thus optimize the loading time.
How to block Ads
There are two ways in Octoparse to set up “Ad Blocking”.
1. Select the step of “Go To Web Page”, you can easily locate “Ad Blocking” in “Advanced Options”.
2. Or click “Settings”, then you can see the “Block ads” option.
|
Tips! 1. Using the Ad blocking technique may change the structure of some webpages. If so, please adjust the XPath to re-locate the elements. Learn more about locating elements with XPath 2. Using Ad blocking may cause page loading issue. If you find a page loads improperly, for example, the page cannot be loaded at all, please do not select Ad blocking. |
.
Written by: Yanni
Revised by: Yina