Proxy Integration with Bright Data (V8.1)
FollowOctoparse is an easy-to-use web scraping tool allowing you to build your own crawler, no coding required.
Octoparse can assist by bypassing the majority of anti-scraping technologies. This is done by extending wait times, automatically switching the browser, and more. In some cases, an IP proxy network is still required. For example, many large retail sites have strict restrictions on abnormal access, in this case, it is recommended to rotate the IP address at a certain frequency.
Integrate Bright Data's Proxy Manager with Octoparse
Getting started with Octoparse:
- Download and install Octoparse
- To build a crawler on your own choose the Advanced Mode and click the Task button
- Type in your target domain/s in the website field
- Scroll down and click save URL
Generate high-quality IP addresses with Bright Data
- Sign-up for Bright Data and input a payment method for your $5 credit bonus
- Go to your Bright Data Dashboard and click Add Zone
- Select a network type and press Add Zone
- Once you have created your zone, click the pencil icon on the left side to go the zone details
- Within the zone details page, go to the IPs section
- Click Download IPs list
How to paste the IP addresses directly into your Octoparse crawler
- Open the task that requires the use of IPs in Octoparse
- Click settings on the top left corner to set up IP proxy
- Scroll down go to Anti-blocking settings
- Choose Use IP Proxies
- Then click on the Settings
- In the IP Proxies field, copy and paste the Bright Data downloaded IPs list
