Scraping a master and child records
I am new to web scraping and have an atypical requirement. I would be grateful if someone could point me in the right direction (or tell me it can’t be done). Instead of capturing data on multiple records I would like to capture data for a single record spread over three web pages. The web pages are set for up for a many-to-one relationship but in this case there is always exactly one child record. Page one displays the data for the parent record (which I need to capture) and has a link that takes you to page two. Page two contains a clickable list of the (one) child records. Clicking on the ‘child’ takes you to the detail record for the child record which I also need to capture. Any help would be greatly appreciated.
-
Hi flanagap,
Thank you for reaching out.
We'll need to check the source code of the webpage to evaluate the feasibility of your target data. Could you please kindly send us the URLs for further investigation? And let us know how to navigate to the target data with screenshots. Thank you for your time.
Best regards,
-
Hi flanagap,
Thank you for your reply.
Here are the tutorials that might be helpful:
Best regards,
Please sign in to leave a comment.
Comments
3 comments