Cloud Live Log and Run History are essential tools for troubleshooting tasks in Octoparse. They allow you to check the status of your Cloud runs, review detailed logs, and export historical data.
1. Cloud Runs Details (Cloud Live Log)
When you start a Cloud run, a window will automatically pop up showing run details. You can also access the window by clicking on this icon from the Task List:
Tip: You can disable the auto pop-up in settings if you don’t want the window to open every time.
Key Information Available in the Cloud Run Interface
At the top of the interface, you’ll see a summary including:
Data volume
Task status
Duplicate count
Time spent
Average running speed
Tabs in the Cloud Run Interface
1. Task Overview
Task Overview includes Run Initiated, Start Time, End Time, Distinct Data, CAPTCHA Attempts.
2. Data List
This tab shows all the data that has been scraped.
3. Subtask Status
Displays the number of subtasks along with details such as start time, end time, time spent, status, and data extracted.
You can Restart or view Details for each subtask.
Subtask details include error screenshots and event logs, which help diagnose issues if the Cloud run does not work as expected.
4. Recent Runs
Recent Runs provides the information of all the historical runs.
You can click the Export Data button in the Action column to export the data from one run.
2. Cloud Runs History
To view Cloud Run history:
Go to the Dashboard.
Click "..." (More).
Select Cloud Runs → Cloud Run History.
Cloud Run History Interface
This section shows the details of each Cloud run, including:
Batch ID
Start Time
End Time
Data Extracted
Exported records
Note: By clicking on the data in the Summary column, you can check the data for each cloud run and click the Export Data button in the Action column to export data from one single run.