Downloading Session Logs (Edge)
In a Hevo Edge Pipeline, all work is done through jobs. The activities done by a job are captured in a session log, which contains all the information about the actions taken by the Pipeline while running a job. You can use the session log for various reasons, such as understanding the job execution and troubleshooting failures. The Hevo Support team can also use a session log to determine the cause of any errors in the Pipeline.
Note: Hevo does not capture any sensitive information in the session logs.
What is a session log?
The session log comprises details of the tasks carried out by a job. A job may have multiple phases:
-
Ingestor: This phase is responsible for initializing the ingestion task, data ingestion, and handling failures.
-
Loader: This phase is responsible for initializing the loading task, applying the schema, loading data, and handling failures.
-
Notifications: This phase captures information about the errors and failures encountered in the Pipeline run.
-
Cleanup: This phase is responsible for cleansing the session log of any sensitive information, such as the database hostname and port number.
Each of these phases may run in parallel in the job and create their respective logs. The information from each individual log is aggregated and written to the session log in ascending order of the timestamps of their log entries.
Note: Currently, the logs from all the phases are not captured in the session log.
How to Download the Session Log?
To download the session log of a job:
-
In the Pipelines Detailed View of your Edge Pipeline, click Job History from the Configuration tabs.
-
In the Jobs list, click anywhere in the summary row of the job whose session log you want to download.
-
In the Job Details and Summary section, click Download Session Log.
Hevo aggregates the log entries and prepares the session log for downloading.
Once the session log is ready, it is downloaded to your machine.