Introduction
Elementary is an open-source data observability solution for modern data teams.
Monitor your data warehouse in minutes, and be the first to know of data issues. Gain immediate visibility, monitor your data and operation, detect data issues, and understand the impact and root cause.
- Data anomalies monitoring as dbt tests Continuous monitoring of data quality metrics, freshness, volume and schema changes, including anomaly detection, configured and executed as dbt tests.
- Data lineage made simple, reliable, and automatedTracing the actual upstream & downstream dependencies in the data warehouse.
- Operational monitoringMonitor the operations of your data stack, and centralize metadata easily. Collect dbt artifacts, run and test results as part of your runs.
- Slack alerts Get informative notifications on data issues, schema changes, jobs and tests failures.
Quick start
Quick start: Data monitoring as dbt tests in minutes.
(Not a dbt user? you can still use Elementary data monitoring, reach out to us on Slack and we will help).
Data anomalies monitoring as dbt tests
Elementary delivers data monitoring and anomaly detection as dbt tests.
Elementary dbt tests are data monitors that collect metrics and metadata over time. On each execution, the tests analyze the new data, compare it to historical metrics, and alert on anomalies and outliers.
Elementary data monitors as tests are configured and executed like native tests in your project!
Demo
Elementary monitoring Slack alert example
Roadmap
Our plan is to eventually build a data reliability platform that is open, transparent and powered by the community. A solution that data teams could easily integrate into their workflows, detect data incidents and prevent them from even happening in the first place.
We are working on Datasets monitoring, Lineage history, Column level lineage, Full lineage, and more.
dbt package
For the data monitoring and dbt artifacts collection, we developed a dbt package.
The monitoring configuration is configured in your dbt project, and the monitors are dbt macros and models.
.png?alt=media&token=0f93a898-4efc-44e5-9036-bd10c069510b)
elementary dbt package lineage graph
Community & Support
For additional information and help, you can use one of these channels:
Integrations
License
Last modified 15d ago