Crawler Knowledge – Octoparse

XPath, HTML, Excel, Regex, Python

Is there a template I can use to scrape a site with a drop down menu + search button?
- rocktopus
- October 09, 2020 21:51
0 votes 1 comment
How to scrap emails from this website?
- ganbaatar
- October 08, 2020 09:28
0 votes 1 comment
How can I make sure to scrape only new listings and not all listings on the site?
- Yanni
- September 29, 2020 02:15
0 votes 1 comment
Youtube Channel scraping template doesn't work. What's going wrong with it?
- Yanni
- September 29, 2020 01:29
0 votes 1 comment
Pagination
- Atifhussain540
- September 09, 2020 09:30
0 votes 1 comment
Hello, I would like to download databases from Yellow pages (Canada) but the phone number is hidden as on this example:
- Fergus
- September 07, 2020 02:20
0 votes 1 comment
I cannot get the pagination to work on the next page button.
- Kara
- September 04, 2020 08:10
0 votes 1 comment
Is it possible to perform a pagination on this website? https://www.boersen-zeitung.de/index.php?l=14
- Kara
- September 04, 2020 07:10
0 votes 1 comment
Is there an option to only get DD/MM/YYYY-HH:MM or just the date or maybe make it adjustable by the user depending on the user's needs of date and time format That would be very useful for us.
- Kara
- September 04, 2020 04:11
0 votes 1 comment
Using RegEx to clean data, there are two lines scraped, how can I get only the first line?
- Kara
- September 04, 2020 02:59
0 votes 3 comments
I built a task to scrape Google Maps
- Kara
- September 03, 2020 11:33
0 votes 1 comment
I only want to get the stores that are getting above 4+ star ratings on google maps, how can I do that?
- Kara
- September 02, 2020 03:03
0 votes 1 comment
The pagination is not working. It goes from page 1 to page 11 directly.
- Kara
- August 31, 2020 09:41
0 votes 1 comment
I am faced with another xpath problem.
- Kara
- August 31, 2020 09:33
0 votes 1 comment
Am I right in thinking Octoparse can't pick up special characters such as # and £?
- Lesley
- August 31, 2020 07:48
0 votes 0 comments
How to scrape certain listings for an entire state in Yelp? I can only see how to do it city by city.
- Lesley
- August 31, 2020 04:33
0 votes 0 comments
Is it possible to have more than 20 ASINs pulled for Amazon?
- Lesley
- August 28, 2020 15:25
0 votes 0 comments
Taken from this website https://www.olx.co.id/motor_c87 If i want to write an xpath for this, and in the command i want it with "itemPrice", how do i write it?
- Kara
- August 28, 2020 10:18
0 votes 1 comment
Pagination goes from page 2 back to page 1
- kassiherr
- August 20, 2020 21:45
0 votes 2 comments
problem scrolling in a popup window
- MlkHadjer
- August 17, 2020 21:22
0 votes 1 comment
Scraping Data from Multiple URLs
- paforson
- June 22, 2020 10:58
0 votes 2 comments
Not sure what's going on but the last 2 days I've encounter various problems
- Fergus
- June 11, 2020 13:46
0 votes 1 comment
I attached the html code in this file need to click on the SVG tag to search the site, it does not have any button, and I can not create URL for search, this is what I have: Any idea how can I click on that svg?
- Fergus
- June 10, 2020 09:48
0 votes 1 comment
I wolud like to use xpath to get filed I marked on the screenshot.
- Fergus
- June 10, 2020 09:38
- Edited
0 votes 1 comment
But I am little bit confused that I am using advance mode>>wizard mode>>List and detail, in this case, there is no any option of use custom XPath. Please the attached screenshot for your reference.
- Fergus
- May 25, 2020 10:26
0 votes 1 comment
I want octoparse to give me a list of the links where it says "Hauptausschuss" "Bildungsausschuss" "Stadtentwicklungsaussschuss"
- Fergus
- May 21, 2020 08:53
0 votes 1 comment
I am having issues scraping text without a bunch of code for image embedded in the webpage.
- Kara
- May 21, 2020 08:50
0 votes 0 comments
I need to extract data where the Xpath is not constant and the only way to constantly extract it correctly is to use regular expressions to find where the field is, and then extract data.
- Fergus
- May 21, 2020 08:43
0 votes 1 comment
Website with two scrolling bar
- jwangacvb
- May 18, 2020 14:07
0 votes 1 comment
I am trying to extract e-commerce data from a page that has infinite scroll enabled.
- Fergus
- May 15, 2020 08:27
0 votes 1 comment