Query history
Elementary generates the lineage graph and operational information from the DWH logs.
Relying on logs enables capturing the true state in a highly accurate manner, as logs describe transformations, loads, and changes that actually happened, and whether they succeeded.

Snowflake query and access history

The supported sources of query history in Snowflake are information_schame.query_history and the ACCOUNT USAGE QUERY_HISTORY view and ACCESS_HISTORY view. The differences and required permissions are detailed on the Snowflake integration page.

BigQuery query history

The query history in BigQuery is pulled from the information schema, by accessing a view that contains jobs metadata by project.

Unsupported query types

Snowflake unsupported query types:
  • Copy from statements
Found another unsupported type? Please let us know (Slack or GitHub issue) and we will fix it!