“I love pop-up ads,” said nobody…ever. Pop-ups have to be one of the most universally hated parts of online marketing. They're annoying, interruptive, and distracting. For us web scrapers, an unexpected pop-up slows down the page loading and blocks the page elements we want to extract. So how can we close the pop-up when building the task?
There are actually two ways to cope with pop-ups in Octoparse. For demonstration purposes, we'll use the WenCNFT website as an example. Check the URL below: https://www.wencnft.com/calendar
Create a new task in Octoparse using the sample URL. We can notice that a website disclaimer pops up and blocks the entire webpage.
1. Close the pop-up manually
Our first option is to close the pop-up manually. Toggle on Octoparse's browse mode and click the purple cross to close the pop-up. Remember to toggle off the browse mode before moving on to the next step.
2. Use Click Items
The second option is to add click items in our workflow to tell Octoparse to close the pop-up for us. Click on the close cross in the top right of the pop-up first and select Click element from the Tips panel. Set an AJAX timeout for this action.
Either way, we will close the pop-up. You can go on to edit your task. ：）