Hi I am new to Octoparse. I want to scrap tabular data that is behind a password login paywall. I have three questions:
1. Should I start the task from the login page or from the page with the search results? I have attached a screenshot of the results from a standard search query.
2. As you can see, there are 17 pages of 50 results per page. Is there an easy way to scrap the 50 rows per page for the entire 17 pages for this search query.
3. Is there an easy way to have Octoparse autonomously run this search query to download in 7-day blocks all data for the past 5 years?
Please sign in to leave a comment.