In today's web environment, many websites use Cloudflare to protect against malicious activity, presenting challenges for data scraping. In this tutorial, we'll explain what Cloudflare verification is and walk you through two proven solutions to bypass it.

Cloudflare verification is a security measure used by websites to distinguish between legitimate users and automated bots. It often involves CAPTCHA challenges, browser integrity checks, and rate limiting. These verifications help protect websites from threats like DDoS attacks, spam, and scraping, but they also pose significant obstacles for web scraping tools.

Starting from version 8.7.2, Octoparse can solve the Cloudflare challenges automatically for you. When the website shows Cloudflare captcha, all you need to do is tick the Bypass Cloudflare with credit option and click on Confirm when the Cloudflare turnstile appears and wait for it to be bypassed automatically.

This feature costs $1.5 per 1,000 requests, so make sure you have enough add-on credits in your account before using it.

The deduction happens in two situations:

Each attempt to resolve the captcha is considered as one request, whether it's successful or not. The success rate for solving these challenges is around 80%.

You also have the option to bypass Cloudflare verification manually whenever you’re editing or running your tasks. For a detailed guide on how to do this, refer to this tutorial.