Skip to main content

Documentation Index

Fetch the complete documentation index at: https://docs.elementary-data.com/llms.txt

Use this file to discover all available pages before exploring further.

Monitoring the performance of your data pipeline is critical for maintaining data quality, reliability, and operational efficiency. Proactively monitoring performance issues enables to detect bottlenecks and opportunities for optimization, prevent data delays, and avoid unnecessary costs. There are two ways to identify and act on performance issues in Elementary:
  • Performance pages — explore execution times, trends, and fail rates for models and tests across your pipeline
  • Performance & Cost Agent — analyzes patterns across your pipeline, surfaces inefficiencies, suggests query improvements, and flags redundant tests that are slowing things down
Use the pages to monitor and spot outliers. Use the agent to investigate and get actionable recommendations. Elementary monitors and logs the execution times of your dbt models and tests.

​
Models performance

Navigate to the Model Duration tab. The table displays the latest execution time, median execution time, and execution time trend for each model. You can sort the table by these metrics and explore the execution times over time for the models with the longest durations It is also useful to use the navigation bar to filter the results, and see run times per tag/owner/folder.

​
Tests performance

Navigate to the Test Execution History tab. On the table you can see the median execution time and fail rate per test. You can sort the table by this time column, and detect tests that are compute heavy. It is also useful to use the navigation bar to filter the results, and see run times per tag/owner/folder.

​
Optimize with the AI Agent

Once you’ve identified slow or expensive models and tests, use the Performance & Cost Agent to go deeper. It analyzes query patterns, surfaces inefficiencies, suggests improved SQL, and identifies redundant tests that slow down your pipeline — so you can act on what the performance data is showing.