Data Warehouses
Redshift
Data Warehouses
Redshift
Data anomalies monitoring as dbt tests
Full support since version 0.4.0.
Redshift connection profile
After installing Elementary’s dbt package upon running dbt deps
,
you can generate Elementary’s profile for usage with edr
by running the following command within your project:
dbt run-operation elementary.generate_elementary_cli_profile
The command will print to the terminal a partially filled template of the profile that’s needed for edr
to work.
Fill in the missing authentication fields
in the output and copy it to ~/.dbt/profiles.yml
.
The profiles.yml
file to connect to Redshift should contain a profile in the following format:
Redshift
## REDSHIFT ##
## By default, edr expects the profile name 'elementary'. ##
## Configure the database and schema of elementary models. ##
## Check where 'elementary_test_results' is to find it. ##
elementary:
outputs:
default:
type: redshift
host: [hostname, like hostname.region.redshift.amazonaws.com]
## User/password auth, other options (IAM) require other configs ##
user: [username]
password: [password]
dbname: [database name]
schema: [schema name] # elementary schema, usually [schema name]_elementary
threads: 4
keepalives_idle: 240 # default 240 seconds
connect_timeout: 10 # default 10 seconds
# search_path: public # optional, not recommended
sslmode: [optional, set the sslmode used to connect to the database (in case this parameter is set, will look for ca in ~/.postgresql/root.crt)]
ra3_node: true # enables cross-database sources
We support the same format and connection methods as dbt. Please refer to dbt’s documentation of Redshift profile for further details.