Hidden data with JS

Follow

FabriScraping

• October 20, 2020 14:08

Hi all,
I am encountering an issue of encripted data.can
When I browse a page with the Firefox dev tool I can go though the structure and I find a div with a certain @attribute.

However, when the same page is loaded in Octoparse the structure is altered and the @attribute has disappeared.

Is there any way to align what octoparse analyze with the same thing I browse with Firefox?

Thanks in advance.

FAbrizio

0

• 

  Emma

  • October 21, 2020 08:32

  Hi FabriScraping,

  You can use the Octoparse XPath Tool to test the page structure when it's loading in the built-in browser, to learn more, please refer to: https://helpcenter.octoparse.com/hc/en-us/articles/360021314091-Octoparse-XPath-Tool

  Best regards,

  0

  Comment actions Permalink
• 

  FabriScraping

  • October 21, 2020 09:50

  Hi Kara,
  
  thanks for your answer. O checked and I got confirmed that Octoparse shows that page after the JS encription has taken place. Therefore there is no possibility to retrieve most of the data.
  
  Just a personal note and suggestion for the future, I believe that an approach as Firefox doe would be more productive. Firefox, I do not know how as I am not techical at that point, shows the page structure before Js has made it unreadable.
  
  For your reference an example is:

  https://www.manomano.it/p/vela-ombreggiante-triangolare-in-polietilene-620-x-620-x-620-cm-7231724?model_id=2061347
  
  Regards
  Fabrizio

  0

  Comment actions Permalink
• 

  Emma

  • November 06, 2020 10:06

  Hi Fabrizio,

  Thank you for your suggestion, I'll make sure to forward it to our Product Team, appreciate it.

  Best regards,

  0

  Comment actions Permalink

Please sign in to leave a comment.