Crawler Knowledge – Octoparse

XPath, HTML, Excel, Regex, Python

XPath to click through list of links and then extract
- Venture3One3
- April 25, 2022 19:03
- Edited
0 votes 0 comments
Scrape Indeed.com (master and Child records)
- kscitx
- January 09, 2022 01:15
0 votes 0 comments
Creating a variable field that auto increments within a loop
- tatgift
- December 05, 2021 00:33
0 votes 0 comments
Can someone PLEASE help me to scrape digital assets from Storyblocks
- mitchfromtoronto
- December 01, 2021 07:43
0 votes 0 comments
Xpath 1st elment 2nd element 3rd element
- ankitpal
- October 19, 2021 09:15
0 votes 1 comment
Scrapping data from from css class
- arjunyadav
- July 26, 2021 11:15
1 vote 1 comment
I guess it goes here... Naming?
- BigJosher
- February 24, 2021 20:43
0 votes 6 comments
Website screenshot
- andre2ar
- February 18, 2021 17:01
0 votes 2 comments
Working between 2 browser tabs
- gordonk
- January 05, 2021 18:05
0 votes 1 comment
Is there a way to use outer loop variables to enter text inside of inner loop?
- jllTCG
- December 14, 2020 02:51
0 votes 2 comments
Is RegEx only for premium users?
- vaibhamin
- December 08, 2020 02:24
0 votes 1 comment
I'm trying to extract the social media and website links from each of the companies in this list https://www.techinasia.com/companies?country_name[]=Pakistan but I cant build a crawler that will click on each of the companies. Is there a way?
- Nerfeeeeee
- November 19, 2020 12:24
0 votes 1 comment
Mouse Over (Hover-on) Problem
- rMatias
- November 06, 2020 10:33
0 votes 1 comment
Run task from code
- ronhud
- October 28, 2020 10:41
0 votes 1 comment
Hidden data with JS
- FabriScraping
- October 20, 2020 14:08
0 votes 3 comments
Is there a template I can use to scrape a site with a drop down menu + search button?
- rocktopus
- October 09, 2020 21:51
0 votes 1 comment
How to scrap emails from this website?
- ganbaatar
- October 08, 2020 09:28
0 votes 1 comment
How can I make sure to scrape only new listings and not all listings on the site?
- Kiki
- September 29, 2020 02:15
0 votes 1 comment
Youtube Channel scraping template doesn't work. What's going wrong with it?
- Kiki
- September 29, 2020 01:29
0 votes 1 comment
Pagination
- Atifhussain540
- September 09, 2020 09:30
0 votes 1 comment
Hello, I would like to download databases from Yellow pages (Canada) but the phone number is hidden as on this example:
- Scarlett
- September 07, 2020 02:20
0 votes 1 comment
I cannot get the pagination to work on the next page button.
- Emma
- September 04, 2020 08:10
0 votes 1 comment
Is it possible to perform a pagination on this website? https://www.boersen-zeitung.de/index.php?l=14
- Emma
- September 04, 2020 07:10
0 votes 1 comment
Is there an option to only get DD/MM/YYYY-HH:MM or just the date or maybe make it adjustable by the user depending on the user's needs of date and time format That would be very useful for us.
- Emma
- September 04, 2020 04:11
0 votes 1 comment
Using RegEx to clean data, there are two lines scraped, how can I get only the first line?
- Emma
- September 04, 2020 02:59
0 votes 4 comments
I built a task to scrape Google Maps
- Emma
- September 03, 2020 11:33
0 votes 1 comment
I only want to get the stores that are getting above 4+ star ratings on google maps, how can I do that?
- Emma
- September 02, 2020 03:03
0 votes 1 comment
The pagination is not working. It goes from page 1 to page 11 directly.
- Emma
- August 31, 2020 09:41
0 votes 1 comment
I am faced with another xpath problem.
- Emma
- August 31, 2020 09:33
0 votes 1 comment
Am I right in thinking Octoparse can't pick up special characters such as # and £?
- Lesley
- August 31, 2020 07:48
0 votes 0 comments