Package Features
The Elementary dbt package is designed to power data observability use cases for dbt pipelines. This package will upload logs and metadata generated from your runs as dbt artifacts into tables in your data warehouse. Additionally, it offers a wide range of tests, including anomalies in volume, freshness, columns and different dimensions of your data. The impact of the package ondbt run
is minimal, and most of the processing happens as part of the data tests that are executed on dbt test
.
What are dbt packages and packages.yml?
What are dbt packages and packages.yml?
A dbt package is additional Jinja and SQL code that is added to your project, for additional functionality. In fact, each package is a dbt project. By adding a package to your project, you are adding the package code to be part of your project, you can reference its macros, execute its models, and so on.Add packages to your project by creating a
packages.yml
file under the main project directory (where your dbt_project.yml
is), and adding the relevant package. After you add a new package, run dbt deps
to actually pull its
code to your project. This is also how you update packages.
Some packages we recommend you check out: dbt_utils
, dbt_date
, codegen.Elementary schema
The Elementary package creates various models to store information about collected dbt artifacts and test results. To avoid mixing with your existing models, we recommend configuring a dedicated schema for the Elementary models using the dbt custom schema option. Here is an example configuration, that creates a schema with the suffix '_elementary' for elementary models:dbt_project.yml