Does the service put a load on the destination website?
Hi there, Does this service have the tendency to slow down or put a load on the destination website services on which the scrapping is done?
-
Official comment
Yes, Octoparse would put a load on the target website.
Octoparse is based on a built-in browser and simulates the human behaviors on web pages. So it would "really" open the website, click on the button to scrape the data.
All scraping bots would put a load on the website. (That's one of the reasons why website owners don't like scraping bots.)
What we need to do is to control the scraping speed to make avoid overload the websites. You may check this tutorial for the related information on how to not overload a website with Octoparse: How to scrape websites without being blocked?
Comment actions
Please sign in to leave a comment.
Comments
1 comment