Data monitoring
(Not a dbt user? you can still use Elementary, reach out to us on Slack and we will help).

Data monitors as dbt tests

Elementary is the first solution that delivers data monitoring and anomaly detection as dbt tests. Elementary dbt tests are actually data monitors that collect metrics and metadata over time. On each execution, the tests analyze the new data, compare it to historical metrics, and alert on anomalies and outliers. These tests are configured and executed like any other tests in your project.

How to use Elementary to monitor data?

Elementary data monitoring includes a dbt package and CLI. The dbt package is added to your project. It includes models, tests, and dbt artifacts uploader.
After you add the package to your project, you can add Elementary tests to your models and sources configuration. When you execute dbt run, elementary creates models and upload artifacts and configuration. When you execute dbt test, elementary data monitors collect metrics according to your configuration, and analyze to detect anomalies. If anomalies are detected - the test will fail/warn. After your dbt run and dbt test, execute the Elementary CLI edr monitor command. This will aggregate the results, and alert to Slack on new anomalies.

Install elementary dbt package

Execution and usage overview

The usage flow is as follows:
  1. 1.
    Install the dbt package and related configuration. (Not a dbt user? you can still use Elementary, reach out to us on Slack and we will help).
  2. 2.
    Configure data monitors as tests, just like you configure your native dbt tests.
  3. 3.
    Run dbt run as usual (the models in this run have minimal performance impact).
  4. 4.
    Run dbt test as usual, but this time Elementary data monitoring and anomaly detection will run as part of your tests.
  5. 6.
    Run edr monitor to aggregate the results and get Slack alerts.

CLI monitor advanced options

CLI monitor advanced options
Have a question