Working with Jobs (Edge)
Once you have set up an environment, create jobs to run your dbt models against your Destination data. Jobs automate testing, merging, and deployment so that every change to your dbt models goes through a consistent, controlled process.
In Transformations, you can create the following job types:
-
Continuous Integration (CI) Job: Runs automatically when a pull request (PR) is opened. Validates dbt models and runs tests to confirm that code changes do not break existing logic before they are merged.
-
Merge Job: Runs automatically when a PR is approved and merged into the Git branch specified by the environment. Applies the validated changes to the environment.
-
Deploy Job: Builds and updates dbt models in your Destination. Can be triggered manually, on a schedule, or automatically after a Pipeline sync.
You can create multiple jobs of each type. For example, to run different deploy schedules across environments, or to separate CI checks for different branches.
Prerequisites
-
An active Hevo account. You can start with a 14-day full-feature, free trial account.
-
A GitHub account with access to the repository containing your dbt project.
-
A Transformation project set up and connected to your GitHub repository.
-
At least one environment created for the project.
How Job Types Work Together
CI, merge, and deploy jobs are designed to work in sequence, so every change to your dbt models is tested, merged, and deployed in the correct order.
To achieve this:
-
Open a pull request: A CI job runs automatically to validate the dbt models and run tests. If the CI job fails, resolve the errors before proceeding. Do not merge a PR with a failing CI job.
-
Merge the pull request: Once the PR is approved and merged, a merge job runs automatically to apply the changes to the environment.
-
Deploy to your Destination: A deploy job runs to build and update the dbt models in your Destination, making the latest data available for analysis.
Together, these jobs ensure that your dbt transformations remain reliable and consistent.
The following diagram illustrates how the job types are connected:
