Hello I've recently set up a flow wherein I am simply scraping URLs off a site that specifically lists sites. ("Top 500 Shopify websites")
This site is perfect as there are no Captia or popups to verify you are not a bot.
Everything runs smoothly but after 150 lines (page 15 in the Octoparse tab and page 5 on the site) it stops running and says "Run completed", but there are still other 100 more page to run.
I even set the paginate loop to 500 times, but it does not seem to work.
I have attached screenshot of my flow, my settings and the notification of the finished run. Please help.
Please sign in to leave a comment.