You might encounter some websites that don’t have a search button or the button is not clickable. For example, if you open https://www.bukalapak.com/ in your browser, you will find that you can only conduct searches with the “Enter” key, not the search button.
If the target website’s search button is not clickable in the browser, it won’t work with the Octoparse. Therefore, Text/ keyword input is not suitable in this case, instead, we suggest you generating the link of search results in your browser. Then directly copy and paste the search results URL on Octoparse can avoid complicated steps.
(Check out the complete tutorial of How can I extract data with a list of URLs?）
It will require you to split one task into two tasks and three steps.
-
Step 1. Input keywords into the target website in your browser, generating a new URL
-
Step 2. Use the new URL in Octoparse to scrape URLs of the detail pages (Task 1)
-
Step 3. Import Task 1 result. Scrape information from detail pages （Task 2）
Here are tutorials to teach you how to do that.
Tutorial 1: Scrape product information from bukalapak
Tutorial 2: Scrape professional details from Houzz
Tutorial 3: Scrape product information from Houzz