since i have a standard account, i have created dozens of tasks for Amazon Crawling. And I have the problem with the captcha again and again.
I've actually worked around that problem. Some tasks ran successfully for several days in the cloud (6 tasks in parallel) without captcha. But I noticed that some days nothing is extracted at all, because the captcha appears suddenly, although no changes were made in the task. So it can't be because of the Amazon website, on other days everything works fine again. I'm afraid that there are IP addresses in the cloud, because there is high activity on some days.
I thought about upgrading to Professional, I will get better IP addresses. Well, since I upgraded, I don't see any performance improvements. Even with some tasks the captcha is coming all the time and so nothing is extracted.
Could you please explain to me why the tasks in the cloud behave differently every day. Because in the long run, the crawler is useless to me because of its unreliability.
Please sign in to leave a comment.