Troubleshooting Failed Events in a Pipeline
Whenever Hevo finds that an Event cannot proceed ahead in the Pipeline, it marks the Event as Failed. Some key causes of Event failures include:
-
Schema incompatibility and conflicts: The schema of incoming objects does not match the schema of the Destination object. This may happen if the Source schema has changed over time or if you have mapped fields of incompatible types between Source and Destination.
-
Transformation related errors: Transformation code provided by you may have bugs.
-
Incorrect mappings: There can be errors while manually mapping Source and Destination tables.
-
Transient Errors: Some Events may be marked as Failed, and are errors that Hevo is able to recover from on its own, without needing any action from your end. For example, a network or connectivity failure with your Destination.
Read Reasons for Event Failures for more information.
Failed Events are held by Hevo for 7 days, after which they are purged permanently. Purged Events are not replicated to your Destination. Hence, Hevo recommends that you resolve all failed Events within 7 days.
If the Events are sidelined due to un-mapped Event Type, they are retained only for seven days and are deleted post that.
Viewing Failed Events
All the failures requiring action from you are made visible on the Pipeline Activity section in the Pipeline Overview tab for inspection.
Click on the Events Failed count to get a detailed list of failed Event Types and their failure reasons. You can also view the Number of Events for each failure reason.
Note: The Events Failed count and the failed Event Types list do not include Event Types that you have skipped during schema mapping.
Click on VIEW SAMPLE next to a failure reason to browse through few of the failed Events from that category. Click Copy to copy a failed Event’s JSON representation or Download to download the entire sample of failed Events.
You can also view sample failed Events for an Event Type from the Pipelines -> Transformations page.
To do this:
-
Click the Select Event Type drop-down.
-
Enable the Events not Loaded option to view only the Event Types with failed Events.
-
Select the required Event Type and click GET SAMPLE.
- Articles in this section