I am having some trouble with a task. The problem is that everything works, but it skips some pages. Because of that it only scrapes 77 vacancies instead of all of the 147 vacancies on the page.

Comments

1 comment

  • Scarlett

    Hi,

    Octoparse didn't skip some pages but leave out the last 3 posts on every page due to excluding some elements out of the loop item cycle.

    Please go to the "loop item" and change the fixed list to the variable list and then input the XPath below. You'll see the loop item add 3 new posts in the cycle compared with the old XPath.

    "//div[@class="job-listing-content"]//h3[1]"

    0
    Comment actions Permalink

Please sign in to leave a comment.