Elementary Cloud Platform
Elementary is a data observability platform tailored for dbt-first data organizations.
The unique dbt-native architecture seamlessly integrates into engineers’ workflows, ensuring ease of use and smooth adoption. The platform provides out-of-the-box monitoring for critical issues, tools to effortlessly increase coverage, and integrations for end-to-end visibility across the data stack.
Elementary promotes ownership and collaboration on incidents, and enables the whole data organization to take an active role in the data quality process. By automatically measuring and tracking data health, it helps teams transition from reactive firefighting to proactively communicating data health to consumers and stakeholders.
When do I need a data observability platform?
Cloud Platform Features
Detection & Coverage
Elementary integrates powerful anomaly detection and dbt tests into a unified detection strategy. Effective detection of data issues requires a comprehensive approach, including both pipeline and data monitoring, validation tests, anomaly detection for unexpected behavior, and a single interface to manage it all at scale.
Anomaly Detection
ML-powered monitors automatically detect data quality issues. Out-of-the-box for volume and freshness, and opt-in for data quality metrics.
Data Tests
Validate data and track the results of dbt tests, dbt packages tests (dbt-utils, dbt-expectations, elementary) and custom SQL tests.
Schema Validation
Validate there are no breaking changes in tables schema, JSON schema, and downstream exposures such as dashboards.
Runs & Performance
Track failures and runs of jobs, models, and tests overtime. Pipeline failures and performance issues can cause data incidents, and create unneceserry costs.
Code & UI Configuration
Configure Elementary in code, or via the UI for non-technical users or for adding tests in bulk. The platform opens PRs to your repo, saving hours of tedious YAML edits.
Test Recommendations
Coming soon!
Triage & Response
Detecting issues is just the first step to achieve data reliability. Elementary offers tools to create an effective response plan, for faster recovery. This includes investigating the root cause and impact of issues, communicating issues to the relevant people, assigning owners to fix issues, keeping track of open incidents and more.
Data Lineage
Column-level lineage that spans through sources, models and BI tools, enriched with monitoring results. Enables granular root cause and impact analysis.
Ownership
Define clear ownership of data assets and enable owners to be informed and accountable for the health and status of their data.
Actionable Alerts
Distribute highly configurable alerts to different channels and integrations. Automatically tag owners, and enable setting status and assigns at the alert level.
Automated Grouping
Different failures related to the same issue are grouped automatically to a single incident. This accelerates triage and response, and reduces alerts fautigue.
Incident Management
Manage all open incidents in a single interface, with a clear view of status and assignees. Track historical incidents and high-level incidents metrics.
Collaboration & Communication
The data team doesn’t live in a silo - you have many stakeholders. The only way to improve data trust is by bringing in more team members, users and stakeholders to the data health process. Elementary fosters collaboration by allowing you to easily share and communicate the status of issues, the overall health of the data platform and progress made to improve it with the broader organization.
Overview Dashboard
Up to date dashboard with current status and trends of data issues. Share the dashboard with others, enable them to slice results and stay informed.
Assets Tags
Enable effective collaboration and communication by grouping related data assets and tests by business domains, data products, priority, etc.
Data Catalog
Search and explore your datasets information - descriptions, columns, column descriptions, compiled code, datasets health and more.
Data Health Dashboard
See the Data Health scores of all your datasets by domain and share with stakeholders.
Architecture and Security
- You install the Elementary dbt package in your dbt project and configure it to write to it's own schema, the Elementary schema.
- The package writes test results, run results, logs and metadata to the Elementary schema.
- The cloud service only requires
read accessto the Elementary schema, not to schemas where your sensitive data is stored. - The cloud service connects to sync the Elementary schema using an encrypted connection and a static IP address that you will need to add to your allowlist.
Our product is designed with Security and Privacy in mind.
SOC 2 certification: Elementary is SOC2 type II certified!