I am new to web scraping and have an atypical requirement. I would be grateful if someone could point me in the right direction (or tell me it can’t be done). Instead of capturing data on multiple records I would like to capture data for a single record spread over three web pages. The web pages are set for up for a many-to-one relationship but in this case there is always exactly one child record. Page one displays the data for the parent record (which I need to capture) and has a link that takes you to page two. Page two contains a clickable list of the (one) child records. Clicking on the ‘child’ takes you to the detail record for the child record which I also need to capture. Any help would be greatly appreciated.
Please sign in to leave a comment.