Crawler Knowledge – Octoparse

XPath, HTML, Excel, Regex, Python

How to scrape certain listings for an entire state in Yelp? I can only see how to do it city by city.
- Yanni
- August 31, 2020 04:33
0 votes 0 comments
Is it possible to have more than 20 ASINs pulled for Amazon?
- Yanni
- August 28, 2020 15:25
0 votes 0 comments
Taken from this website https://www.olx.co.id/motor_c87 If i want to write an xpath for this, and in the command i want it with "itemPrice", how do i write it?
- Emma
- August 28, 2020 10:18
0 votes 1 comment
Pagination goes from page 2 back to page 1
- kassiherr
- August 20, 2020 21:45
0 votes 2 comments
problem scrolling in a popup window
- MlkHadjer
- August 17, 2020 21:22
0 votes 1 comment
Scraping Data from Multiple URLs
- paforson
- June 22, 2020 10:58
0 votes 2 comments
Not sure what's going on but the last 2 days I've encounter various problems
- Scarlett
- June 11, 2020 13:46
0 votes 1 comment
I attached the html code in this file need to click on the SVG tag to search the site, it does not have any button, and I can not create URL for search, this is what I have: Any idea how can I click on that svg?
- Scarlett
- June 10, 2020 09:48
0 votes 1 comment
I wolud like to use xpath to get filed I marked on the screenshot.
- Scarlett
- June 10, 2020 09:38
- Edited
0 votes 1 comment
But I am little bit confused that I am using advance mode>>wizard mode>>List and detail, in this case, there is no any option of use custom XPath. Please the attached screenshot for your reference.
- Scarlett
- May 25, 2020 10:26
0 votes 1 comment
I want octoparse to give me a list of the links where it says "Hauptausschuss" "Bildungsausschuss" "Stadtentwicklungsaussschuss"
- Scarlett
- May 21, 2020 08:53
0 votes 1 comment
I am having issues scraping text without a bunch of code for image embedded in the webpage.
- Emma
- May 21, 2020 08:50
0 votes 0 comments
I need to extract data where the Xpath is not constant and the only way to constantly extract it correctly is to use regular expressions to find where the field is, and then extract data.
- Scarlett
- May 21, 2020 08:43
0 votes 1 comment
Website with two scrolling bar
- jwangacvb
- May 18, 2020 14:07
0 votes 1 comment
I am trying to extract e-commerce data from a page that has infinite scroll enabled.
- Scarlett
- May 15, 2020 08:27
0 votes 1 comment
I am having some trouble with a task. The problem is that everything works, but it skips some pages. Because of that it only scrapes 77 vacancies instead of all of the 147 vacancies on the page.
- Scarlett
- May 14, 2020 10:44
0 votes 1 comment
something is wrong with my loop. it loops true but doesn't collect the results of box... what did i do wrong with the xpath?
- Emma
- May 14, 2020 10:00
0 votes 0 comments
Data Extraction
- birdoo2
- May 13, 2020 07:29
0 votes 1 comment
I have been trying to scrape from Flipkart.com and I am not satisfied with the output I am seeing.
- Scarlett
- May 13, 2020 06:47
0 votes 1 comment
when I am trying to paginate on this site. The paginating is a bit difficult to me, because there is no next button, after display for 20 pages, then click on “..” button to display another
- Scarlett
- May 13, 2020 06:44
0 votes 1 comment
I used the new version and auto-detect to capture data from this URL https://www.indeed.com.pe/Empleos-en-Lima
- Scarlett
- May 12, 2020 04:18
0 votes 1 comment
During the crawl, sometimes the fields are detected using xpath but they are not extracted. Please see the attached screenshot.
- Scarlett
- May 12, 2020 04:15
- Edited
0 votes 1 comment
How do you create a pagination if there is no next page?
- Scarlett
- May 09, 2020 07:28
0 votes 1 comment
Please assist me, I would like to extract data from the page using a variable list.
- Scarlett
- May 09, 2020 04:09
0 votes 1 comment
Google Map Xpath
- Scarlett
- May 03, 2020 05:00
0 votes 1 comment
In new version 8.1 does not have RegEx add details. As in older version I can do it easily but new version cant find it.
- Scarlett
- April 28, 2020 02:32
1 vote 1 comment