I'm trying to scrap some information about the firms on this site. There are about 500 of these pages: https://network.axial.net/company/catalus-capital
There's a section with keywords describing the industries they've invested in:
I would like to expand "show all" and all the sections to get at the long lists of specific industry sectors.
I assume I need to click on "show all" and then use a variable list to click on each arrow to expand each section, and then us another variable list to get each line of the bulleted list.
I can see them being selected in Octoparse, and I can set the rules to clean them up, and set the option to combine them into one row, but when I run the workflow none of that actually happens in practice. Particularly the "combine" step doesn't seem to actually combine the data from each bullet. I'm not sure how to troubleshoot that.
Please sign in to leave a comment.