You are browsing a tutorial guide for Octoparse's latest version. If you are running an older version of Octoparse, we strongly recommend you upgrade because it is faster, easier, and more robust! Download and upgrade here if you haven't already done so!
💡 Try our pre-set Bing Search template for faster setup!
Bing is one of the most popular search engines around the world. In this tutorial, we are going to show you how to scrape result information from Bing.com.
Target URL Example:
What We'll Extract:
✔ Search result titles
✔ Destination URLs
✔ Page descriptions
✔ Timestamp of extraction
The main steps are shown in the menu on the right and you can download the demo task:
1. Set Up the Task
Enter your Bing search URL
Click "Start" to load the page
2. Configure Pagination
Scroll down and click the ">" (next page) button
In Tips Panel, select "Loop Click"
Set AJAX Timeout to 7 seconds
3. Extract Data Fields
For each search result (excluding ads):
Click the 2nd non-ad result title
In Tips Panel:
Select "All Similar Elements"
Choose "Text" for titles
Choose "Link" for URLs
For descriptions: Click result text → "Text"
(Optional) Add current timestamp via "+" icon
The workflow should look like this:
4. Refine with XPath (Exclude Ads)
Edit the Loop Item's XPath to:
//li[@class='b_algo']
Update field XPaths:
Title:
//h2URL:
//h2/aDescription:
//p
📚 Related tutorials:
5. Run & Export Data
Click "Run" → Choose "Standard Mode" for local execution
Export results as:
Excel
CSV
HTML
JSON
Sample data
