when I extract data with URL loop, the site sometimes redirects me to another URL. I want to know when it happens, so tried to extract page URL before and after redirection. However, the address in Octoparse changes so quickly, that I can't save the original URL. So, I have input list of original URLs, output list with URLs after redirection, but i don't have any connection between them. Is there any way to extract page URL before redirection, and then extract page URL after it, so I can find out how each URL is redirected?
UPDATE: So far, the only solution I found is to Go to Web Page, enter the URL from the loop to some text box on the page, and then extract text from the text box and page URL. It should be sufficient for now, but if someone knows more efficient solution, then I'd be glad to see it.
Please sign in to leave a comment.