Identifying Duplicates

Follow

rjamhk

• November 20, 2020 07:41

Hi All, 

New user to Octoparse and enjoying it so far.

Wondering if it is possible to see which lines/records have been extracted that have been identified as duplicates just so I can review whether it is appropriate to include/exclude them from final exported data. 

0

• 

  Brian

  • November 30, 2020 08:50

  Hi rjamhk,

  Thank you for reaching out.

  Sorry but it cannot be done in the software, you can check that in excel after the data was exported, and since cloud extraction removes duplicates automatically, to keep the duplicates, you can add the extraction time as one data field: Can I keep the duplicates extracted in Cloud?

  Best regards,

  0

  Comment actions Permalink

Please sign in to leave a comment.