Does the service put a load on the destination website?

Follow

Yina

• May 11, 2020 03:08

Hi there, Does this service have the tendency to slow down or put a load on the destination website services on which the scrapping is done? 

0

• Official comment

  

  Yina

  • May 11, 2020 03:13

  Yes, Octoparse would put a load on the target website.

  Octoparse is based on a built-in browser and simulates the human behaviors on web pages. So it would "really" open the website, click on the button to scrape the data.

   

  All scraping bots would put a load on the website. (That's one of the reasons why website owners don't like scraping bots.)

  What we need to do is to control the scraping speed to make avoid overload the websites. You may check this tutorial for the related information on how to not overload a website with Octoparse: How to scrape websites without being blocked?

  Comment actions Permalink

Please sign in to leave a comment.