If you've run into any of the issues below, you may want to try setting up IP proxies manually in Octoparse:
- If you are unable to log into Octotoparse because your company or institution uses intranet and restricts external requests. T
- If your target website is very sensitive to web scraping and implements anti-scraping strategies such as IP blocking to stop scraping activities.
In this tutorial, I will show you how to set up the proxies to resolve the issues mentioned above.
1. Use a proxy to login Octoparse
If you fail to log in to Octoparse due to network restrictions, you can set up a proxy on the login interface.
- Click the on the top right
- Enter proxy information as required
- Click "Test" and see if the connection is good
- Click "Confirm" to save
2. Rotate external proxy servers to counteract IP blocking
*Note that it is only possible to rotate external proxy servers for local runs but not Cloud runs.
- Launch the task which you want to set up proxies for
- Click on the top left
- Tick "Use IP Proxies" and enter the proxy info in the "Settings"
Octoparse only supports HTTP proxies. Please separate the IP address of the proxy server and port number with a colon. e.g. 126.96.36.199:2318.
- Click "OK" and "Save" to save your changes
Edited by Isabel