This article will illustrate how does Octoparse deal with the dilemma with the "press enter" function when there is no available submit button.
You will need the below URL as an example to better understand how it works under certain situations.
There will be two options for jumping over the functionality limitations whenever you meet the issues.
- Press enter function
- URL concatenation
Press enter function
When opening the webpage of Mazda, it is quite obvious that there is no available submit button to conduct the search after you have entered your keywords.
You will need to set the press enter function to let the system automatically press the enter key to search when executing the workflow.
- Click the action settings button of the Enter Text action
- Select the button "Hit the Enter/Return key when finishing entering"
- Set appropriate time for timeouts
- Set up AJAX timeouts when the website uses the AJAX technique
- Set up scroll times when the current website requires scrolling before fully loaded
You will need to refer to the following for more details about AJAX and scrolling websites.
Some websites use URL concatenation to construct new URLs to search around their websites.
For example, the home domain of one website, https://www.allaboutincontinence.co.uk/
if you search the below keyword: id-for-men-level-3, the URL of the keyword search result: https://www.allaboutincontinence.co.uk/id-for-men-level-3
You will be able to take the above URL as a starting point to set up your workflow to avoid the situation of no submit button exists on the homepage. It also saves scraping time as we don't need to enter text and click the search button.
If you need to batch generate a URL list from multiple keywords search, you can use our "Batch generate URL" function:
Is this article helpful? Contact us at any time if you need our help!